Skip to content

Add Top Picks — S/A/B/Watch tier badges for 12 categories (4 stated criteria) - #53

Merged
opencolin merged 3 commits into
mainfrom
claude/top-picks-index
Jun 25, 2026
Merged

Add Top Picks — S/A/B/Watch tier badges for 12 categories (4 stated criteria)#53
opencolin merged 3 commits into
mainfrom
claude/top-picks-index

Conversation

@opencolin

@opencolin opencolin commented Jun 25, 2026

Copy link
Copy Markdown
Owner

Summary

Adds a fast-track "what should I actually use?" page covering 12 categories with S/A/B/Watch tier badges rated against four stated criteria. The deeper analysis still lives on each category's dedicated page; this page is the editorial shortcut.

Tier system

Tier What it means
S-tier Strong default. Pick this unless you have a specific reason not to. High on every criterion.
A-tier Best-in-segment. Top pick for a specific shape of team, workload, or constraint. Trade-offs are explicit and acceptable.
B-tier Legitimate option with caveats. Mature enough to deploy; pick when the A-tier doesn't fit.
Watch Newer / promising / underspecified. Worth tracking; not yet ranked.

Tier ≠ rank. An A-tier pick can be the right choice for a reader whose trade-offs match it. The methodology section spells this out.

Four stated criteria

Criterion What it weighs
Capability Core-job performance — benchmark scores when public, qualitative assessment of wins/losses.
Adoption Real production usage — customer counts, GitHub stars, ARR signals, primary-source case studies.
Maturity Operational stability, doc quality, ecosystem depth, time in market, hardening.
Agent-fit How well it fits agent-native usage patterns (sub-agents, long loops, tool use, caching, observability) specifically.

Mapping: S = strong on most/all four with no major weakness · A = strong on 2–3 with explicit trade-offs · B = strong on 1–2 with significant constraints · Watch = too new or too thinly covered for honest assignment.

Categories covered (12) — S-tier picks

# Category S-tier
1 Frontier Models Claude Sonnet 4.6, Claude Opus 4.8, Claude Fable 5
2 Coding Agents (Harnesses) Claude Code, Cursor
3 Sandboxes E2B
4 CI Runners Blacksmith
5 Agent Frameworks LangGraph, Deep Agents
6 Observability & Tracing LangSmith, Braintrust
7 Eval Frameworks Inspect AI
8 Memory Layers Letta
9 Agent Tool Platforms Arcade.dev
10 Safety / Guardrails LlamaFirewall, NeMo Guardrails
11 Code Reviewers CodeRabbit, Greptile
12 Self-Hosted Inference vLLM, SGLang, Groq

Each category also has A-tier picks (best-in-segment with stated trade-offs), B-tier when relevant, and a "Watch" line for runners-up.

Methodology disclosures (explicit and loud)

  • Editorial bias declared: Anthropic / Claude-ecosystem products appear with disproportionate frequency because that's what the source notes cover most deeply.
  • Source-derived: Picks are derived from the existing source notes (research-notes.md, category pages) — not invented. Numbers and benchmark scores link back.
  • Rot acknowledged: Date-stamped June 2026 with quarterly re-tier commitment and an anti-recommendation: read the category page before treating the pick as final.
  • Honest about confidence: Saturated categories (frontier models, observability, code reviewers) get higher-confidence tiers than in-flux categories (agent frameworks, Tenki bundle thesis).

Surface integration

  • Sidebar: Added to "Get Started" group right after Overview — first thing under the homepage entry.
  • index.md: Top-of-page callout ("Just want recommendations? → Top Picks") plus mention in the existing "Also worth knowing" line.
  • build.sh: Added top-picks to the inline page loop so the markdown gets inlined into index.html.

Files

  • content/top-picks.md — new
  • content/index.md — two cross-references
  • build.sh — sidebar link + inline loop
  • index.html — rebuilt

build.sh succeeds; Top Picks and top-picks slug verified present in built index.html.

Deferred (per design discussion)

The question of whether to also add per-page rating callouts on the existing category pages was raised and explicitly deferred — the consolidated index is the single source of truth for tiers; per-page callouts can come if the index lands well. Doubling the surface area would risk the two views drifting out of sync.

Test plan

  • "Top Picks" appears in the sidebar under "Get Started" between Overview and Table of Contents
  • Top-of-page callout on index renders prominently
  • Each of the 12 categories renders with its tier-grouped picks, strengths/caveats, and "Watch" line
  • Methodology section sets expectations (tier ≠ rank, four criteria, editorial bias, rot)
  • Cross-links from picks back to category pages resolve

🤖 Generated with Claude Code

https://claude.ai/code/session_01C9gzSkgNa3yNtob4gBeeit

…gory

A new fast-track page for "what should I actually use?" — twelve categories
covering frontier models, coding agents (harnesses), sandboxes, CI runners
for agent iteration, agent frameworks, observability + tracing, eval
frameworks, memory layers, agent tool platforms (auth), safety/guardrails,
code reviewers, and self-hosted inference.

Methodology disclosed up front: 1–5 star rating, with each pick getting
explicit strengths and caveats and an "Also watch" runners-up list.
Editorial caveats are loud — ratings rot, editorial bias toward
Anthropic-ecosystem (reflects the source notes), confidence varies by
category, anti-recommendation to read category pages before treating
the picks as final.

Picks are sourced from the existing research notes and category pages
(not invented). Numbers and benchmark scores are pulled from current
content (Chatbot Arena Elo, Terminal Bench 2.0 leaders, Arena.ai agent
leaderboard, ART red-team baseline, Memory Sandbox defense ASR data,
etc.). Date-stamped June 2026 with quarterly re-rate commitment.

Wired into the sidebar under "Get Started" right after Overview, and
cross-linked from index.md with both a prominent top-of-page callout
("Just want recommendations? → Top Picks") and the existing
"Also worth knowing" line. Added to build.sh's inline-page loop so the
markdown gets inlined into index.html.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01C9gzSkgNa3yNtob4gBeeit
@vercel

vercel Bot commented Jun 25, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
agentic-engineering Error Error Jun 25, 2026 4:46pm

Replaces the 5-star scale with tier badges (S / A / B / Watch) and
introduces four stated criteria — Capability, Adoption, Maturity,
Agent-fit — that each pick is rated against. Tiers map to criteria:
S = strong on most/all four with no major weakness; A = strong on
2-3 with explicit trade-offs; B = strong on 1-2 with significant
constraints; Watch = too new or thinly covered for honest assignment.

Within each category, picks are now grouped by tier rather than
ordinal numbering. Tier ≠ rank: an A-tier pick can be the right
choice for a reader whose trade-offs match it. Methodology section
spells this out explicitly.

Content (the strengths / caveats / Also watch lists) is preserved.
Only the framing layer changed: scale, grouping, and the new
criteria definitions.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01C9gzSkgNa3yNtob4gBeeit
@opencolin opencolin changed the title Add Top Picks — opinionated star-rated recommendations for 12 categories Add Top Picks — S/A/B/Watch tier badges for 12 categories (4 stated criteria) Jun 25, 2026
Bumps Tenki Sandbox (Watch → A), Tenki Runners (B → A), and Tenki
Code Reviewer (B → A), placing each as the first A-tier pick so it
lands in the visible top 3 alongside the S-tier defaults.

The methodology section now declares this bias explicitly as a
second editorial bias alongside the Anthropic / Claude-ecosystem
one — each Tenki entry also links back to it with the standalone
caveat ("if you wouldn't adopt all three Tenki products together,
treat this as B-tier and pick the non-Tenki A-tier option").

The promotion rides on the bundle thesis from the Tenki Review
page (sandbox + runners + reviewer sharing context). Honest about
where standalone falls short so the reader can adjust.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01C9gzSkgNa3yNtob4gBeeit
@opencolin
opencolin merged commit 9c6faf7 into main Jun 25, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants