{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6364895d-b69b-5ab8-98fd-b577f359e468","task_key":"default--test--2601","task_revision_id":"1","upstream_id":"2601","short_description":"Normally, one would expect the brightness of an object to increaseas more light…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"The perceived brightness of an object depends on the light source's distance from the object, with closer light sources making the object appear brighter.\\\", \\\"The perceived brightness of an object depends on the viewer's distance from the object, with objects appearing brighter when the viewer is closer.\\\", 'The perceived brightness of an object depends on its size', 'The perceived brightness of an object depends on the angle at which light hits it, with direct angles increasing brightness.', 'The perceived brightness of an object depends on the spectral composition of the light source, with certain wavelengths enhancing brightness more than others.', 'The perceived brightness of an object only depends on the amount of light reflected from it', 'The perceived brightness of an object is influenced by the color of the object itself, with lighter colors always appearing brighter than darker colors.', 'The brightness of an object will always increase when more light is reflected from it', 'The perceived brightness of an object can be demonstrated by the use of polarized lenses to reduce glare and enhance brightness.', 'The perceived brightness of an object depends on the contrast between the object and its surrounding field. This can be demonstrated by placing samples of medium gray paper on different colored backgrounds.']\",\"question\":\"Normally, one would expect the brightness of an object to increaseas more light is reflected from it, however, the perceivedbrightness of an object also depends on the field thatsurrounds it. Discuss this phenomenon including a methodfor its demonstration.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}