{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6b0fcb4-947c-5a79-9cf1-c9a268e05ec7","task_key":"default--test--10049","task_revision_id":"1","upstream_id":"10049","short_description":"Under what conditions is the net electric flux through a closed surface…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['only when there are no charges outside the surface', 'only when the charges are in motion', 'only when the electric field is uniform', 'only when the enclosed charge is negative', 'only when the charge is at rest', 'only when the enclosed charge is symmetrically distributed', 'only when the surface is a perfect sphere', 'only when the enclosed charge is positive', 'under any conditions', 'only when all nearby charges are symmetrically distributed']\",\"question\":\"Under what conditions is the net electric flux through a closed surface proportional to the enclosed charge?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}