{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"34d1385f-283f-58a0-8f4f-7a4eee971134","task_key":"default--test--290","task_revision_id":"1","upstream_id":"290","short_description":"On October 17, Thomas Long purchased two $1,000 bonds, bearing 6% interest…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['$2,006 and $1,996', '$1,990 and $1,970', '$2,015 and $1,995', '$2,006 and $1,986', '$2,020 and $2,000', '$2,010 and $1,980', '$1,960 and $1,986', '$2,000 and $1,970', '$1,995 and $1,975', '$1,980 and $1,960']\",\"question\":\"On October 17, Thomas Long purchased two $1,000 bonds, bearing 6% interest payable January 1 and July 1, at 98. Find his total cost, and the net proceeds to the seller. Assume a brokerage fee of $5 per bond.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}