{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d46eb49-6095-5936-8f54-ea13e0a2abac","task_key":"default--test--10507","task_revision_id":"1","upstream_id":"10507","short_description":"Define and draw a contrast between compilers and interpreters .","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"[\\\"Both compilers and interpreters convert high-level language into an intermediate form, which is then executed by the computer's processor.\\\", 'A compiler directly executes high-level language statements without converting them, while an interpreter converts each statement into machine code and stores it.', 'Interpreters translate the entire program into machine language before execution, while compilers execute the code without translating it.', 'Both compilers and interpreters translate the entire program into machine language.', 'Compilers convert code into an intermediate representation that is executed by another program, while interpreters convert code directly into actions without any intermediate form.', 'A compiler interprets the statements one by one, while an interpreter translates the entire program into machine language.', 'Compilers convert each high-level language statement into a low-level language during runtime, while interpreters perform this conversion ahead of time.', 'A compiler translates the entire program into the machine language equivalent, while an interpreter interprets the statements one by one and directs the computer to do what the high-level statement intends.', 'Compilers and interpreters are the same in how they process high-level languages.', 'Interpreters create a standalone executable file from the high-level code, while compilers execute the code line by line as it is written.']\",\"question\":\"Define and draw a contrast between compilers and interpreters .\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}