{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e9a06ffd-1f55-554b-97f3-d95ea1114b0a","task_key":"default--test--10467","task_revision_id":"1","upstream_id":"10467","short_description":"Explain and discuss why the branch and link register (BALR) instruction is…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['BALR instruction is important because it is used for data encryption and security purposes.', 'BALR instruction is important because it increases the graphical processing capabilities of the computer.', 'BALR instruction is important because it directly manipulates arithmetic operations.', 'BALR instruction is important because it simplifies the programming process.', 'BALR instruction is important because it serves as a primary instruction for input/output operations.', 'BALR instruction is important because it speeds up the program.', \\\"BALR instruction is important because it allows for base address loading into the base register of the program, which is crucial for the program's execution.\\\", 'BALR instruction is important because it enables the computer to perform multitasking more efficiently.', 'BALR instruction is important because it allows for immediate value assignment to multiple registers.', 'BALR instruction is important because it reduces memory usage.']\",\"question\":\"Explain and discuss why the branch and link register (BALR) instruction is usually one of the most important instruc-tions of the IBM/360-370 computers?\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}