{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9643d5a6-f9a2-5b39-bc9a-5f3e64f99548","task_key":"default--test--2614","task_revision_id":"1","upstream_id":"2614","short_description":"How does face validity differ from content validity?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Face validity is measured quantitatively, while content validity is assessed qualitatively.', 'Content validity and face validity are the same', 'Content validity is determined by expert consensus, while face validity is based on statistical analysis.', 'Face validity refers to the relevance of the test, while content validity refers to the complexity of the test', \\\"Face validity is about the coverage of the material within a test, while content validity is about the test's difficulty.\\\", \\\"Content validity involves ensuring the test challenges are suitable for the intended age group, while face validity involves the test's ability to predict future performance.\\\", 'Content validity measures the extent to which a test measures a sample of the behavioral domain of interest, while face validity refers to the extent that the test looks like it measures what it purports to measure.', 'Face validity concerns the appropriateness of the content of a test for a particular situation, while content validity is about the appearance of accuracy.', \\\"Face validity is related to the test's transparency to the examinees, whereas content validity deals with the test's alignment with curriculum standards.\\\", 'Face validity measures the extent to which a test measures a sample of the behavioral domain of interest, while content validity refers to the extent that the test looks like it measures what it purports to measure']\",\"question\":\"How does face validity differ from content validity?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}