{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bbaab449-a805-5bbf-9fe5-9777bf75289c","task_key":"default--test--2803","task_revision_id":"1","upstream_id":"2803","short_description":"Characterize a person who scores high on internality on the Internal-External…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['A person with high internality believes success is predominantly determined by external factors like fate or luck.', 'A person with high internality is likely to be dependent and influenced easily.', 'A person with high internality on the Internal-External Control Scale is likely to be achievement-oriented, independent, resistant to influence, successful, and prefers tasks relying on skills rather than chance.', 'A person with high internality tends to be more passive and waits for others to solve problems.', 'A person with high internality is likely to be unsuccessful and lacking in ambition.', 'A person with high internality feels that they have little influence over the outcomes of their actions.', 'A person with high internality prefers tasks relying on luck rather than skills.', 'A person with high internality frequently blames others for their own mistakes or failures.', 'A person with high internality is more prone to experience anxiety and stress due to uncontrollable external events.']\",\"question\":\"Characterize a person who scores high on internality on the Internal-External Control Scale.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}