Benchmark AI / Public workspace

SciCode

Science / Code

SciCode evaluates the ability to solve scientific research problems through code. Problems are decomposed into subproblems; this dev import preserves the relationships between 15 parent problems and 50 subproblems.

Japanese introduction

科学研究の問題をコードで解く能力を評価するベンチマークです。親問題を複数の小問題に分けており、今回のdev取得では15親問題と50小問題の関係を保持します。

scicode

Full text65 tasksProblems imported

Official source

Full text: eligible public problems include text, images and discussion.

Tasks

Whole public benchmark.

Public problems
65
Formats
scicode (15) · scicode-step (50)
Problems with images
0
Answer availability
Answer published by the source (65)
Configs
Default (65)
Splits
dev (65)
Awaiting a first discussion
65

Discussion