{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ca53a570-6088-5580-95b5-74e488dd5e9e","task_key":"default--test--11690","task_revision_id":"1","upstream_id":"11690","short_description":"A bariumtitantecapacitor is made by cutting a hollow BaTi0_3 (high…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['150 × 10^-12F', '500 × 10^-12F', '100 × 10^-12F', '450 × 10^-12F', '700 × 10^-12F', '650 × 10^-12F', '550 × 10^-12F', '393 × 10^-12F', '200 × 10^-12F', '250 × 10^-12F']\",\"question\":\"A bariumtitantecapacitor is made by cutting a hollow BaTi0_3 (high dielectric,\\\\epsilon_R= 5000) cylinder in half along a diameter and depositing silver electrodes on the two rectangular faces of one half. Find the capacitance between these faces. It is given that the inner and outer radii of the cylinder are 1 and 2 centimeters respectively with a length of 3 centimeters.\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}