{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a177eecc-a7d0-55a5-b942-1cc64bd7dd96","task_key":"default--test--382","task_revision_id":"1","upstream_id":"382","short_description":"Florence Lesson is a saleswoman. She uses her own car to call on customers. The…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['$1,934.64 and $161.22', '$787.44 and $65.62', '$1,934.64 and $787.44', '$2,722.08 and $161.22', '$1,147.20 and $95.60', '$2,722.08 and $226.84', '$787.44 and $161.22', '$1,147.20 and $161.22', '$1,934.64 and $95.60', '$1,147.20 and $65.62']\",\"question\":\"Florence Lesson is a saleswoman. She uses her own car to call on customers. The company reimburses her 10 \\\\textcent for every mile she drives, and pays for parking and tolls. During the past year Ms. Lesson drove 11,472 miles and her expenses for parking and. tolls amounted to \\\\textsection787.44. Find (a) the cost to the company for Ms. Lesson's automobile expenses, and (b) the average cost to the company per month.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}