Issues

• Code-generation judge rejects valid solutions using sys.stdin.buffer.readline() or sys.stdout.buffer

  LiveCodeBench/LiveCodeBench#160 · Filter by author mantuoluozk opened on Sep 30, 2026

• EvalPort: portable interchange for CodeGenerationProblem tasks

  LiveCodeBench/LiveCodeBench#159 · Filter by author adhabnr-ux opened on Sep 27, 2026

• Code execution: generations disqualified by the input-echo guard are dropped from the pass@1 denominator instead of being scored False

  LiveCodeBench/LiveCodeBench#158 · Filter by author shaurya416 opened on Sep 23, 2026

• [Bug] Non-editable pip install of lcb_runner yields a broken package: all subpackages are missing

  LiveCodeBench/LiveCodeBench#155 · Filter by author PharosEast opened on Sep 11, 2026

• --not_fast silently ignores --start_date/--end_date and --release_version; other scenarios ignore the date flags too

  LiveCodeBench/LiveCodeBench#153 · Filter by author AUTHENSOR opened on Sep 5, 2026

• Would an EvalPort-format export of LiveCodeBench be welcome in EvalPort's benchmarks/?

  LiveCodeBench/LiveCodeBench#150 · Filter by author adhabnr-ux opened on Aug 22, 2026

• how to test local llm launched by llam.cpp?

  LiveCodeBench/LiveCodeBench#149 · Filter by author zzsczz opened on Aug 2, 2026

• EvalScope integration: one-command evaluation support for Live-Code-Bench

  LiveCodeBench/LiveCodeBench#148 · Filter by author Yunnglin opened on Jul 24, 2026

• #1 is a real lead, but ranks 2-6 are one statistical tier — consider significance tiers / CIs

  LiveCodeBench/LiveCodeBench#147 · Filter by author ipezygj opened on Jul 19, 2026

• Clarification on LiveCodeBench v6 dataset size (454 vs 175 tasks)

  LiveCodeBench/LiveCodeBench#145 · Filter by author Curry30Messi opened on Mar 25, 2026

• How to specify LMStyle for Qwen3-30B-A3B-Thinking-2507

  LiveCodeBench/LiveCodeBench#143 · Filter by author Curry30Messi opened on Feb 26, 2026

• When will Version 7 be released?

  LiveCodeBench/LiveCodeBench#139 · Filter by author archersama opened on Dec 23, 2025

• Evaluation Support for Custom Output Files

  LiveCodeBench/LiveCodeBench#138 · Filter by author Facico opened on Dec 22, 2025

• Using livecodebench(release_v6) with the datasets lib causes an error! "ValueError: BuilderConfig JsonConfigdoesn't have a 'version_tag' key."

  LiveCodeBench/LiveCodeBench#134 · Filter by author Keithwwa opened on Nov 25, 2025

• Heavy precision problem

  LiveCodeBench/LiveCodeBench#133 · Filter by author NileZhou opened on Nov 5, 2025

• Errors of running time

  LiveCodeBench/LiveCodeBench#132 · Filter by author HelloWorldLTY opened on Nov 2, 2025

• ValueError: Couldn't find cache for livecodebench/code_generation_lite for config 'default-version_tag=release_latest' Available configs in the cache: ['release_latest-version_tag=release_v5']

  LiveCodeBench/LiveCodeBench#131 · Filter by author fkggggg opened on Oct 30, 2025

• Has the --not_fast option been deprecated?

  LiveCodeBench/LiveCodeBench#130 · Filter by author dog-qiuqiu opened on Oct 23, 2025

• Float output precision issue - failed test for abc315_f problem despite correct solution

  LiveCodeBench/LiveCodeBench#129 · Filter by author filip-chodziutko opened on Oct 17, 2025
  1

• Questions regarding Gemini 2.5 pro results on leaderboard

  LiveCodeBench/LiveCodeBench#128 · Filter by author xinqianpku opened on Oct 15, 2025

• Are there plans to update the code execution dataset?

  LiveCodeBench/LiveCodeBench#125 · Filter by author JohnneyQin opened on Sep 29, 2025

• Benchmark Request: Qwen3-Coder + Qwen3-Next

  LiveCodeBench/LiveCodeBench#119 · Filter by author BradKML opened on Aug 13, 2025
  2

• Kindly add supoort for gpt-oss-120b and gpt-oss-20b

  LiveCodeBench/LiveCodeBench#116 · Filter by author JieWu02 opened on Aug 6, 2025
  1

• Discrepancies in the scores of Gemini 1.5 Pro (May)

  LiveCodeBench/LiveCodeBench#114 · Filter by author nandovallec opened on Jul 22, 2025

• Inclusion of non-Attention models

  LiveCodeBench/LiveCodeBench#113 · Filter by author BradKML opened on Jul 21, 2025