{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7591411e-b985-5c16-86fd-ce0021325d37","task_key":"default--test--2422","task_revision_id":"1","upstream_id":"2422","short_description":"What are the experimental uses of the Thematic Apperception Test ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Assessing cognitive abilities', 'Discriminating between groups with different needs, checking the effect of experimental manipulation, determining the intensity of certain feelings in subjects', 'Measuring IQ level', 'Assessing language comprehension', 'Screening for specific personality disorders', 'Predicting career success based on personality traits', 'Analyzing sleep patterns', 'Evaluating mathematical problem-solving skills', 'Diagnosing medical conditions', 'Testing physical endurance']\",\"question\":\"What are the experimental uses of the Thematic Apperception Test ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}