{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"efd58480-1dab-5d37-ac18-77a2a7b32f50","task_key":"default--test--11575","task_revision_id":"1","upstream_id":"11575","short_description":"Two infinite parallel metal plates are charged with equal surface charge density…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['inversely proportional to the distance between the plates.', 'quadruple the field produced by one plate.', 'zero.', 'dependent on the thickness of the plates.', 'dependent on coordinates of field points.', 'proportional to the square of the distance between the plates.', 'double the field produced by one plate.', 'half the field produced by one plate.', 'triple the field produced by one plate.', 'same as that produced by one plate.']\",\"question\":\"Two infinite parallel metal plates are charged with equal surface charge density of the same polarity. The electric field in the gap between the plates is\",\"src\":\"ori_mmlu-electrical_engineering\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}