{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd3ea447-6897-54f9-a3df-9080b5d018e4","task_key":"default--test--2361","task_revision_id":"1","upstream_id":"2361","short_description":"How doesAllport'sconcept of functional autonomy differ from most other theories…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Functional autonomy permits a relative divorce from the past of the organism', \\\"Functional autonomy maintains that current motives are directly tied to an individual's history\\\", 'Functional autonomy posits that behavior is always a reaction to immediate stimuli', 'Functional autonomy indicates that motivation decreases as the organism ages', 'Functional autonomy relies heavily on biological drives', 'Functional autonomy suggests all behavior is a result of learned associations', 'Functional autonomy is solely determined by external rewards and punishments', 'Functional autonomy emphasizes past experiences', 'Functional autonomy requires constant biological reinforcement', 'Functional autonomy is only applicable in early childhood development']\",\"question\":\"How doesAllport'sconcept of functional autonomy differ from most other theories of motivation?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}