{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ffe89fdc-6745-5b95-8e09-cba5d15a9568","task_key":"default--test--2596","task_revision_id":"1","upstream_id":"2596","short_description":"If you rub your eyes long and hard enough, you would eventuallysee some type of…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The rubbing action generates light inside the eye', 'Pressure on the eye temporarily alters the shape of the cornea, leading to distorted visual signals.', 'The mechanical stimulation from rubbing triggers a reflex that causes the pupils to dilate and create patterned visuals.', 'Friction from rubbing generates heat, which causes the illusion of light patterns.', 'It happens due to the production of a natural hallucinogen when pressure is applied', 'The pressure causes the release of stored light energy in the eye', 'The pressure exerted on the eye stimulates the receptor nerve cells at the back of the retina, which normally respond to light, and their response to this pressure, when communicated to the visual area of the brain, produce the experience of light.', 'Rubbing the eyes causes a temporary change in blood flow to the visual cortex, resulting in visual phenomena.', 'The rubbing motion activates latent photoreceptor cells which produce the visual patterns.', 'The optic nerve is temporarily disoriented by the rubbing, resulting in random visual patterns.']\",\"question\":\"If you rub your eyes long and hard enough, you would eventuallysee some type of visual pattern. Explain this phenomenon.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}