{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"68ad747e-f389-58b3-b694-4fb9a29f90da","task_key":"default--test--10515","task_revision_id":"1","upstream_id":"10515","short_description":"A large list of numbers is to be sorted into ascending order. Assuming that a…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['If the array is initially sorted in ascending order, then selection sort will be more efficient than insertion sort.', 'The number of comparisons for selection sort depends on the initial arrangement of elements.', 'The number of data movements in selection sort depends on the initial arrangement of elements.', 'The number of comparisons for bubble sort is independent of the initial arrangement of elements.', 'The number of data movements in bubble sort is independent of the initial arrangement of elements.', 'The number of comparisons for insertion sort is independent of the initial arrangement of elements.', 'The number of comparisons for selection sort is independent of the initial arrangement of elements.', 'If the array is initially sorted in descending order, then insertion sort will be more efficient than selection sort.']\",\"question\":\"A large list of numbers is to be sorted into ascending order. Assuming that a “data movement” is a swap or reassignment of an element, which of the following is a true statement?\",\"src\":\"ori_mmlu-high_school_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}