{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e0558f7-bf31-56cc-a413-cfa365987825","task_key":"default--test--10612","task_revision_id":"1","upstream_id":"10612","short_description":"A train pulls out of the station at constant velocity. The received signal…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['1.5', '2.5', '1.0', '0.0', '0.5', '0.75', '3.0', '1.25', '0.25', '2.0']\",\"question\":\"A train pulls out of the station at constant velocity. The received signal energy thus falls off with time as $1/i^2$. The total received signal at time $i$ is $Y_i = \\\\frac{1}{i}X_i + Z_i$ where $Z_1, Z_2, \\\\ldots$ are i.i.d. drawn from $N(0,1)$. The transmitter constraint for block length $n$ is $\\\\frac{1}{n}\\\\sum_{i=1}^n x_i^2(w) \\\\leq 2  $ for $w \\\\in \\\\{1,2,\\\\ldots, 2^{nR}\\\\}$. Use Fano's inequality to find the capacity for this channel.\",\"src\":\"theoremQA-EECS\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}