Improve quality

[yb175]

Summary by cubic

Improves issue agent report quality with richer timelines/evidence, enforced repository investigation, and GitHub issues that link directly to SigNoz traces. Adds better step normalization and diagnostics to help engineers quickly find the right files and functions.

• New Features

  • Adds SigNoz trace link to GitHub issues; supports SIGNOZ_URL (or SIGNOZ_PORT) in worker for trace URLs.
  • Enforces repo search over trace_tool_names and evaluator components; auto-populates relevant_files, relevant_functions, and repository_findings (with backfill when tools are skipped).
  • Builds a more detailed timeline and evidence from planner output, tool inputs/outputs/errors, and latencies.

• Refactors

  • Normalizes legacy agent steps in worker (preserves planner_output, context, and tool output) and passes evaluator suspected components/root cause/title via metadata.
  • Expands GitHub issue body with executive summary, timeline, root cause, repository intelligence, and confidence as a percentage.
  • Adds detailed run logging and report quality metrics; tracks symbols_searched, files_read, and tool usage.

^{Written for commit dbda81f. Summary will update on new commits.}

Summary by CodeRabbit

• New Features
  • Issue reports now include richer incident timelines, root-cause context, repository findings, and relevant files.
  • GitHub issues can include direct links to the related SigNoz trace.
  • Reports now preserve detailed execution and tool-call evidence, including outcomes and latency.
• Bug Fixes
  • Improved handling of legacy and pre-normalized incident steps.
  • Added fallback context when no repository investigation is performed.
• Improvements
  • Enhanced report quality checks and completion diagnostics.

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 0f9decf2-7064-4e65-90e0-111211345411

📥 Commits

Reviewing files that changed from the base of the PR and between d634205 and dbda81f.

📒 Files selected for processing (4)

• apps/node-api/src/worker.ts
• packages/issue-agent/src/issue_agent/__main__.py
• packages/issue-agent/src/issue_agent/agent.py
• packages/issue-agent/src/issue_agent/evidence.py

---

📝 Walkthrough

Walkthrough

The issue-agent pipeline now preserves richer trace and evaluator context, tracks repository investigation, injects missing report data, and includes SigNoz links and expanded summaries when creating GitHub issues.

Changes

Issue Agent Enrichment

Layer / File(s)	Summary
Snapshot and evidence context apps/node-api/src/worker.ts, packages/issue-agent/src/issue_agent/evidence.py	Trace steps are normalized with planner, context, and tool-call fields; snapshot metadata includes evaluator context and a SigNoz URL; evidence shares a complete trace representation across failure modes.
Agent investigation and report completion packages/issue-agent/src/issue_agent/agent.py	Timeline events, investigation instructions, repository tools, input context, and post-processing now track repository usage and fill missing timeline, file, symbol, and context fields.
GitHub issue publication packages/issue-agent/src/issue_agent/agent.py, packages/issue-agent/src/issue_agent/__main__.py, apps/node-api/src/worker.ts	GitHub issue creation receives snapshot metadata, conditionally renders trace and report sections, and worker logs include report counts and the issue URL.

Estimated code review effort: 4 (Complex) | ~60 minutes

Sequence Diagram(s)

sequenceDiagram
  participant Worker
  participant IssueAgent
  participant Repository
  participant GitHub
  Worker->>IssueAgent: normalized snapshot and metadata
  IssueAgent->>Repository: search_repo, read_file, build_code_graph
  Repository-->>IssueAgent: repository findings
  IssueAgent->>GitHub: create issue with report and trace metadata
  GitHub-->>Worker: issue URL

Loading

Possibly related PRs

• VOID-Platform/void-server#6: Introduced the issue-agent modules that this change extends with richer evidence, metadata, and report handling.
• VOID-Platform/void-server#7: Shares the incident-promotion flow in worker.ts that constructs and submits issue-agent snapshots.

✨ Finishing Touches

📝 Generate docstrings

• Create stacked PR
• Commit on current branch

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch improve-quality

---

_{Comment @coderabbitai help to get the list of available commands.}