{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b88b2f7-d36d-5b6d-b471-b8d29f38de41","task_key":"default--test--3337","task_revision_id":"1","upstream_id":"3337","short_description":"How has the role of internal body secretions in behavior been demonstrated in…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Silk worms spin cocoons based on the phase of the moon', 'Silk worm behavior is controlled by external stimuli', 'Silk worms only spin cocoons in the presence of light', 'Silk worms spin cocoons based on their age', 'Silk worms spin cocoons when they sense vibrations', \\\"Silk worm cocoon spinning is triggered by the silk worm's diet\\\", 'Silk worm larvae spin cocoons in response to changes in temperature', 'Silk worms spin cocoons when juvenile hormone levels are high', 'Cocoon-spinning behavior of silk worm larvae is controlled by hormones', 'Cocoon spinning is a learned behavior in silk worms']\",\"question\":\"How has the role of internal body secretions in behavior been demonstrated in silk worms?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}