{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54f3ae8d-df96-5544-a385-e918010f35d5","task_key":"default--test--10578","task_revision_id":"1","upstream_id":"10578","short_description":"What is the difference between a basic assemblerlanguage macroinstruction and a…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['Assembler instructions handle memory management, while macro instructions are solely for input/output operations.', \\\"Assembler instructions are pre-defined operations in a CPU's instruction set, while macro instructions are user-defined and often vary between different assemblies.\\\", 'Macro instructions are complex codes that cannot be translated to object code', 'Macro instructions and assembler instructions have no relation', 'Macro instructions are typically used for arithmetic operations, whereas assembler instructions are used for control flow.', 'Macro instructions are a form of high-level programming language, while assembler instructions are low-level codes directly executed by the hardware.', 'Assembler instruction is a larger set than the macro', 'Macro instructions are a sequence of assembler instructions that perform a specific task, with no need for expansion.', 'Macro instructions are single abbreviations for groups of instructions, which must be expanded before translation to object code. Assembler instruction is usually a subset of the macro.']\",\"question\":\"What is the difference between a basic assemblerlanguage macroinstruction and a machine or imperative instruction. Indicate what, if any, relationship exists between them.\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}