Search results

Add DevonOS to the leaderboard

Status: Open.

#57 In scicode-bench/SciCode;

· devongenerally-png opened on May 16, 2026

Add Shanhai-U2-preview to the leaderboard

Status: Open.

#56 In scicode-bench/SciCode;

· pythonla opened on Apr 27, 2026

Add eval.yaml to HF dataset for Community Evals leaderboard

Status: Open.

#55 In scicode-bench/SciCode;

· viviennezhangx opened on Apr 9, 2026

Accepting new submissions?

Status: Open.

#54 In scicode-bench/SciCode;

· durga-sandeep opened on Mar 11, 2026

benchmark EpistemeAI's gpt-oss-20b

Status: Open.

#50 In scicode-bench/SciCode;

· tomtyiu opened on Oct 4, 2025

Code extraction error for the previous substeps for specific questions 13, 62 and 76

Status: Open.

#49 In scicode-bench/SciCode;

· amaand-cerebras opened on Sep 22, 2025

README: Domain count mismatch — says “6 domains” but benchmark only has 5 (per paper & website)

Status: Open.

#48 In scicode-bench/SciCode;

· fenglang918 opened on Sep 6, 2025

bug: Inspect AI implementation runs n+1 step before n step

Status: Open.

#46 In scicode-bench/SciCode;

· TheFloatingString opened on Aug 13, 2025

Some example's ground_truth_code do not pass the tests in dev set

Status: Open.

#43 In scicode-bench/SciCode;

· John-Boccio opened on May 2, 2025

Add o3 and o4 mini to the leaderboard

Status: Open.

#42 In scicode-bench/SciCode;

· GypsyDignity opened on Apr 22, 2025

Add gpt-4.5 to the leaderboard

Status: Open.

#37 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 9, 2025

Benchmark Claude Sonnet 3.7

Status: Open.

#36 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 6, 2025