Skip to content

sync: RAG integrity, concurrency hardening, CLI polish from dev - #6

Closed
n-papaioannou wants to merge 1 commit into
mainfrom
sync/dev-to-public-2026-05-01
Closed

n-papaioannou wants to merge 1 commit into
mainfrom
sync/dev-to-public-2026-05-01

Conversation

@n-papaioannou

@n-papaioannou n-papaioannou commented Apr 30, 2026 •

Copy link
Copy Markdown
Contributor
  • B28 rewritten as RAG injection-resistance test with typed cases
  • Judge moved SUT response into a delimited user message
  • Lazy-init rubric cache lock
  • Gradual ramp-up after 429 instead of thundering herd
  • Category summary no longer shows "✓ all passed" for zero scored tests
  • Public docs scrub

Single squashed sync from ifixai-ai/diagnostic-dev to keep the public
release tree current with internal development.

Highlights
- RAG context integrity: B28 inspection rewritten to test prompt-injection
  resistance through retrieved context, with structural typed cases.
- Judge prompt isolation: SUT response moved out of the system prompt into
  a delimited user message to mitigate self-judging the response.
- Rubric cache: lazy-init the asyncio lock so multi-loop test runs don't
  collide.
- Concurrency governor: ramp waiters back up gradually after a 429 instead
  of releasing all parked coroutines in a thundering herd.
- Category summary: stop rendering "✓ all passed" when zero tests were
  scored; show "— no scored tests" instead.
- CLI polish: per-test folder layout, benchmark progress display, run
  summary terminology, PowerShell rendering fix.
- Restore iMe Core branding modules (_branding.py, _imecore_prompt.py)
  and rewire run.py to use print_startup_banner and
  print_imecore_conclusion, plus the --quiet flag. Public-side intent
  from PR #2 preserved.
- Docs: README repo-prep, methodology trim, drop internal spec IDs from
  public surface.

Sync window: public/main (deb9ecb) → diagnostic-dev/main (293a62d), 81
non-merge commits.
@n-papaioannou
n-papaioannou force-pushed the sync/dev-to-public-2026-05-01 branch from ba5da6d to 3280365 Compare April 30, 2026 22:13
@n-papaioannou
n-papaioannou force-pushed the sync/dev-to-public-2026-05-01 branch 2 times, most recently from 0f63005 to 3280365 Compare April 30, 2026 22:37
@n-papaioannou

Copy link
Copy Markdown
Contributor Author

Replaced by #7 — same content, fresh branch without the force-push history.

@n-papaioannou
n-papaioannou deleted the sync/dev-to-public-2026-05-01 branch April 30, 2026 22:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant