{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"062125be-7b27-5427-b9f5-169a29ea139f","task_key":"default--test--9931","task_revision_id":"1","upstream_id":"9931","short_description":"Two charged, massive particles are isolated from all influence except those…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The particles must be in a vacuum.', 'If the distance between the particles changes, the force will no longer be 0 N.', 'The particles must have the same mass.', 'The particles must have the same sign of charge.', 'The particles must be moving at the same velocity.', 'The particles must be at rest.', 'The gravitational force between the particles must be 0 N.', 'The particles must be of the same type (i.e., both protons, both electrons, etc.).', 'The particles must have the same magnitude of charge.', 'Such a situation is impossible as the net force between the two particles cannot be 0.']\",\"question\":\"Two charged, massive particles are isolated from all influence except those between the particles. They have charge and mass such that the net force between them is 0 N. Which of the following is NOT true?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}