{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"919a4b85-995c-55c8-9134-ba3220072b6d","task_key":"default--test--3298","task_revision_id":"1","upstream_id":"3298","short_description":"According to early studies (performed by Wright) on guinea pig coatcolor, the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['0.217, 0.356', '0.145, 0.425', '0.218, 0.015', '0.478, 0.095', '0.123, 0.450', '0.340, 0.573', '0.194, 0.379', '0.573, 0.38', '0.38, 0.15', '0.308, 0.265']\",\"question\":\"According to early studies (performed by Wright) on guinea pig coatcolor, the total variance in a randomly mating strain was 0.573. The variance in an inbred strain was 0.340. From correlations between relatives in the randomly mating population the heritability (gene effect) was determined to be 38 percent of the total variance. Find the following: (a)variancedue to gene effect; (b)variancedue toepistasisand dominance.\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}