{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ff665a8f-be8b-5925-aedd-c099e55f4a65","task_key":"default--test--3937","task_revision_id":"1","upstream_id":"3937","short_description":"Lemon juice is very acidic, having a pH of 2.1. If we assume that the only acid…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['7.5 × 10^-2 M', '2.1 × 10^-3 M', '1.2 × 10^-2 M', '6.3 × 10^-5 M', '9.0 × 10^-3 M', '5.0 × 10^-2 M', '4.2 × 10^-3 M', '3.7 × 10^-4 M', '8.4 × 10^-4 M', '10^-2.1 M']\",\"question\":\"Lemon juice is very acidic, having a pH of 2.1. If we assume that the only acid in lemon juice is citric acid (represented by HCit), thatHCitismonoproticand that no citrate salts are present, what is the concentration of citric acid in lemon juice? The dissociation constant for citric acid HCit+ H_2O \\\\rightleftarrows H_3O^+ + Cit^- is K_a = 8.4 × 10^-4 mole/liter.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}