{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61aa6221-c6e1-5b13-86a3-e52852437f00","task_key":"default--test--10138","task_revision_id":"1","upstream_id":"10138","short_description":"A 10 kg mass resting on a table is attached to a steel wire 5 m longwhich hangs…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['2 vib/s', '20 vib/s', '18 vib/s', '5 vib/s', '30 vib/s', '8 vib/s', '12 vib/s', '25 vib/s', '15 vib/s', '10 vib/s']\",\"question\":\"A 10 kg mass resting on a table is attached to a steel wire 5 m longwhich hangs from a hook in the ceiling.If the table is removed, the wire is momentarily stretched and the mass commences to oscillate up and down. Calculate the frequency of the oscillation if the cross-sectional area of the wire is 1 sq mm and the value of Young's Modulus is taken to be 19 × 10^11 dynes/cm^2.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}