{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e9035127-af9b-502f-bf36-85c360767650","task_key":"default--test--4022","task_revision_id":"1","upstream_id":"4022","short_description":"The relative rates of diffusion of NH_3(g) and HX (g) can be determined…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['65.00 cm for HF, 75.00 cm for HCl', '50.00 cm for HF, 55.00 cm for HCl', '40.00 cm for HF, 45.00 cm for HCl', '60.00 cm for HF, 70.00 cm for HCl', '75.00 cm for HF, 80.00 cm for HCl', '45.50 cm for HF, 50.23 cm for HCl', '47.50 cm for HF, 52.50 cm for HCl', '52.03 cm for HF, 59.56 cm for HCl', '55.00 cm for HF, 65.00 cm for HCl', '30.00 cm for HF, 35.00 cm for HCl']\",\"question\":\"The relative rates of diffusion of NH_3(g) and HX (g) can be determined experimentally by simultaneously in-jecting NH_3(g) and HX (g), respectively, into the oppo-site ends of a glass tube and noting where a deposit of NH_4X(s) is formed. Given an 1m tube, how far from the NH_3 injection end would you expect the NH_4X(s) to be formed when HX is a) HF, b) HCl?\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}