{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d048521d-700e-51ac-946f-c51b552d8612","task_key":"default--test--10377","task_revision_id":"1","upstream_id":"10377","short_description":"List the common types of registers used in the computer and statetheir purpose.","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['Program Counter, Instruction Register, Memory Address Register, Memory Buffer Register, Accumulator, General Purpose Registers, Index Register, Condition Code Register, Stack Pointer', 'Segment Register, Status Counter, Cache Pointer, Operation Register, Execution Register', 'Control Register, Status Register, Instruction Register, Program Counter', 'Base Register, Command Pointer, Logic Address Register, Accumulator Pointer, Buffer Status Register', 'Input Register, Output Register, Cache Register, Buffer Register, Data Register', 'Arithmetic Register, Logic Register, Data Counter, Command Register, Status Pointer', 'Memory Control Register, Instruction Buffer, Program Status Register, Data Counter, Input/Output Register', 'Stack Register, Queue Register, Instruction Register, Data Register, Buffer Register', 'Control Pointer, Address Buffer, Stack Register, Output Counter, Input Accumulator', 'Address Register, Control Accumulator, Program Logic Register, Execution Pointer, Stack Buffer Register']\",\"question\":\"List the common types of registers used in the computer and statetheir purpose.\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}