Issues

• Publishing the Arena-Hard-v2.0 question set as a portable EvalPort suite?

  lmarena/arena-hard-auto#100 · Filter by author adhabnr-ux opened on Aug 23, 2026

• EvalScope integration: one-command evaluation support for ArenaHard

  lmarena/arena-hard-auto#99 · Filter by author Yunnglin opened on Jul 24, 2026

• i have hard prompt and creative writing score, how to caculate a single score for arena-hard-v2? like qwen

  lmarena/arena-hard-auto#91 · Filter by author jammyWolf opened on Dec 22, 2025
  1

• Hi ! How can i add my new model to lmarena ?

  lmarena/arena-hard-auto#89 · Filter by author hl0737 opened on Oct 31, 2025

• Different Results from ReadMe

  lmarena/arena-hard-auto#85 · Filter by author Zhichao-Jimmy970201 opened on Sep 12, 2025
  4

• Having a single baseline is kinda wrong?

  lmarena/arena-hard-auto#84 · Filter by author TsenreD opened on Aug 7, 2025
  1

• Bootstrapping choice

  lmarena/arena-hard-auto#83 · Filter by author TsenreD opened on Aug 4, 2025

• So confused by the pairwise baselines

  lmarena/arena-hard-auto#82 · Filter by author teknium1 opened on Jul 24, 2025
  1

• The speed is slow and the bar is invalid when I use vllm

  lmarena/arena-hard-auto#81 · Filter by author yhzhang067 opened on Jul 14, 2025
  3

• Questions about the Evaluate Benchmarks

  lmarena/arena-hard-auto#80 · Filter by author Eldo-rado opened on Jul 14, 2025

• The score using Gemini-2.5 as the Judger cannot be aligned

  lmarena/arena-hard-auto#77 · Filter by author QuanWanLear opened on Jun 18, 2025

• Can not finish generate answers with local Llama-3.1-8B-Instruct model with vllm serving

  lmarena/arena-hard-auto#74 · Filter by author jltchiu opened on Jun 2, 2025
  5

• Add Deepseek-R1-0528 Models to Leaderboard

  lmarena/arena-hard-auto#73 · Filter by author Minami-su opened on Jun 1, 2025

• What’s the cost of using Arena-Hard-v2.0-Preview with gpt-4.1 and Gemini-2.5 as the judge models?

  lmarena/arena-hard-auto#72 · Filter by author ZeguanXiao opened on May 29, 2025

• --control-features length

  lmarena/arena-hard-auto#71 · Filter by author Minami-su opened on May 29, 2025
  7