{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a802b1a1-6a6c-599f-a43e-a366f42a3ebc","task_key":"default--test--2371","task_revision_id":"1","upstream_id":"2371","short_description":"List and describe the important methods of investigation in psychology.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Investigation methods include placebo-controlled studies, double-blind experiments, and longitudinal research.', 'Methods include introspection, dream analysis, and free association.', 'Key methods are telepathy, astrology, and phrenology.', 'The major methods of psychology are: the individual case study, naturalistic observation, tests, interviews and surveys, and experimentation.', 'Methods involve case law review, cross-examination, and witness testimony.', 'Methods include evaluation, observation, and statistical analysis.', 'Methods include deduction, induction, and analogy.', 'Methods encompass brain scanning, genetic mapping, and evolutionary tracking.', 'Primary methods are psychoanalysis, behaviorism, and humanistic approaches.', 'Methods include hypothesis testing, qualitative analysis, and correlation studies.']\",\"question\":\"List and describe the important methods of investigation in psychology.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}