Repository navigation
sync: RAG integrity, concurrency hardening, CLI polish from dev - #7
Merged
Merged
Conversation
Single squashed sync from ifixai-ai/diagnostic-dev to keep the public release tree current with internal development. Highlights - RAG context integrity: B28 inspection rewritten to test prompt-injection resistance through retrieved context, with structural typed cases. - Judge prompt isolation: SUT response moved out of the system prompt into a delimited user message to mitigate self-judging the response. - Rubric cache: lazy-init the asyncio lock so multi-loop test runs don't collide. - Concurrency governor: ramp waiters back up gradually after a 429 instead of releasing all parked coroutines in a thundering herd. - Category summary: stop rendering "✓ all passed" when zero tests were scored; show "— no scored tests" instead. - CLI polish: per-test folder layout, benchmark progress display, run summary terminology, PowerShell rendering fix. - Restore iMe Core branding modules (_branding.py, _imecore_prompt.py) and rewire run.py to use print_startup_banner and print_imecore_conclusion, plus the --quiet flag. Public-side intent from PR #2 preserved. - Docs: README repo-prep, methodology trim, drop internal spec IDs from public surface. Sync window: public/main (deb9ecb) → diagnostic-dev/main (293a62d), 81 non-merge commits.
n-papaioannou
requested review from
Sebabaian,
dimneo and
stefyi-4355
as code owners
April 30, 2026 22:42
…surfaces, fix footer
- _print_inconclusive_summary now predicates on TestStatus.INCONCLUSIVE
per test rather than EvaluationMethod.JUDGE per evidence item. The
prior predicate counted every judge-scored evidence item including
passes, leading to a misleading "N evidence items" message.
- Lazy-init of _rubric_cache_lock in analytic_judge moved to module
scope, removing a TOCTOU window where two coroutines could each see
None and create independent locks. asyncio.Lock() at module scope is
loop-agnostic on Python >=3.10 (the project minimum).
- Drop remaining recommendation/remediation surfaces from the report:
* GRADE_INTERPRETATIONS verdict prose blockquote
* Gap Analysis section (current/required/deficit/priority blocks)
* Per-framework "Gap Details" subsections (NOT RUN coverage map)
* JSON gaps[] and grade_interpretation fields
- Footer now distinguishes package version from methodology spec
version (was rendering spec version as if it were software version).
- Category bar palette: orange/yellow/green/blue/pink.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Replaces the version footer with the iMe Core marketing copy used across the public surface. Drops the now-unused VERSION import. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
dimneo
approved these changes
May 1, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.