{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07949781-6f60-5fa3-8ffa-c610c0cd299f","task_key":"default--test--3776","task_revision_id":"1","upstream_id":"3776","short_description":"A .05molalKClsolution is electrolyzed in aHittorfcell at 25°C. A silver…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['.125', '.392', '.675', '.330', '.840', '.560', '.491', '.581', '.750', '.215']\",\"question\":\"A .05molalKClsolution is electrolyzed in aHittorfcell at 25°C. A silver coulometer connected in series with the cell deposited .4068g of silver. The anode solution of theHittorf cell weighed 132.9g and was found to contain 186mg of potassium. What is the transference number of potassium ion? Atomic weights: K = 39.1,Cl= 35.45, Ag = 107.868.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}