{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8835790-f418-5e2a-87c7-85115cbfecd5","task_key":"default--test--2740","task_revision_id":"1","upstream_id":"2740","short_description":"A common criticism of social psychological research is that it isnot externally…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['It is suggested that social psychological findings are not externally valid because they rely on outdated theoretical frameworks', 'The criticism stems from the belief that social psychological research is overly deterministic, ignoring the role of free will', 'The issue is that social psychological studies often have small sample sizes that are not representative of the population', 'Social psychological research lacks external validity due to its heavy reliance on statistical analysis', 'Critics argue that social psychological research overemphasizes the role of social influence and underestimates biological factors', 'The criticism is due to the lack of internal validity in social psychological research', 'Social psychology is criticized for focusing too much on cultural specificity, neglecting universal aspects of human behavior', \\\"Many social psychological experiments are not externally valid because they are often conducted in artificial settings, which may not accurately represent 'natural' human behavior.\\\", 'Social psychological research is criticized because it often fails to consider individual differences']\",\"question\":\"A common criticism of social psychological research is that it isnot externally valid. Explain.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}