{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a3c94a67-63e2-5d08-bf0a-ebc45076bc50","task_key":"default--test--9914","task_revision_id":"1","upstream_id":"9914","short_description":"(1) Two lead balls whose masses are 5.20 kg and .250 kg are placed with their…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['3.46 × 10^-10nt, 5.967 × 10^24 kg', '3.67 × 10^-11nt, 4.800 × 10^24 kg', '3.46 × 10^-7nt, 7.123 × 10^22 kg', '2.18 × 10^-9nt, 5.972 × 10^24 kg', '3.46 × 10^-8nt, 5.967 × 10^22 kg', '2.45 × 10^-10nt, 6.341 × 10^24 kg', '1.23 × 10^-10nt, 6.674 × 10^22 kg', '3.46 × 10^-12nt, 5.967 × 10^26 kg', '3.46 × 10^-9nt, 5.967 × 10^23 kg', '4.52 × 10^-8nt, 6.674 × 10^24 kg']\",\"question\":\"(1) Two lead balls whose masses are 5.20 kg and .250 kg are placed with their centers 50.0 cm apart. With what force do they attract each other? (2) At the surface of the earth g = 9.806 m/s^2. Assum-ing the earth to be a sphere of radius 6.371 × 10^6 m, compute the mass of the earth.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}