{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ee359815-06e1-5bfe-a140-3a2a7a6c364d","task_key":"default--test--2429","task_revision_id":"1","upstream_id":"2429","short_description":"In a conflict situation what behavioral alternatives does the organism have at…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Behavior changes randomly in conflict situations, regardless of other factors.', \\\"An organism's behavior in relation to a goal with conflicting motives would vary depending on the distance from the goal and the relative strengths of the approach and avoidance drives.\\\", 'Behavior is determined solely by the presence of external stimuli, with no internal conflict consideration.', \\\"The organism's behavior is determined by its physical abilities.\\\", 'The organism has a fixed behavioral response to all conflicts, unaffected by goal distance or motivational strength.', \\\"The organism exclusively engages in avoidance behavior, irrespective of the goal's proximity.\\\", 'The organism always avoids conflict.', \\\"The organism's behavior is influenced only by past experiences, not by current conflicts or goals.\\\", 'The organism can only exhibit aggressive behavior towards the goal.', 'Behavior is solely based on the distance to the goal.']\",\"question\":\"In a conflict situation what behavioral alternatives does the organism have at its disposal according to Neal Miller ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}