{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65dba062-d4f1-5489-8309-f49d5f510959","task_key":"default--test--10448","task_revision_id":"1","upstream_id":"10448","short_description":"Assume that a debugger places a breakpoint at a load instruction at virtual…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['0x76E81234; page mapped with READ-ONLY access', '0x77E81234; page mapped with READ/WRITE access', '0x76E81234; page mapped with COPY-ON-WRITE access', '0x01000000; page mapped with COPY-ON-WRITE access', '0x01000000; page mapped with READ/WRITE access', '0x01001234; page mapped with COPY-ON-WRITE access', '0x76E81234; page mapped with READ/WRITE access', '0x01001234; page mapped with READ-ONLY access', '0x77E81234; page mapped with COPY-ON-WRITE access', '0x01001234; page mapped with READ/WRITE access']\",\"question\":\"Assume that a debugger places a breakpoint at a load instruction at virtual address 0x77E81234 (hexadecimal notation) in a debugged process P. If the text segment of P begins at 0x77E80000 in P’s virtual address space and if the debugger has mapped this same text segment at 0x01000000 in its virtual address space, which of the following is the virtual address used by the debugger in its WRITE operation, along with a description of how the debugger has mapped the virtual memory page containing this address?\",\"src\":\"ori_mmlu-college_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}