{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd10f3cf-e9cc-51bf-9bdf-e8daa2b4a33d","task_key":"default--test--2598","task_revision_id":"1","upstream_id":"2598","short_description":"Discuss the advantages and disadvantages of doing field researchand laboratory…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Laboratory research results are less valid than field research because they are always artificial.', 'Laboratory research is always preferable over field research', 'Field research is always better than laboratory research', 'Field research is less ethical than laboratory research because it involves real-world scenarios.', 'Field research yields quicker results than laboratory research.', 'Field research focuses on real people in real-world situations offering more impact but less control and laboratory research provides controlled situations with less impact but more control. There is a basic tradeoff between impact and control in these two methods.', 'Field research provides more control than laboratory research', 'Laboratory research can be conducted in any environment, while field research is limited to specific settings.', 'Field research typically requires more resources than laboratory research.', 'Laboratory research allows for studying larger groups than field research does.']\",\"question\":\"Discuss the advantages and disadvantages of doing field researchand laboratory research with human subjects.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}