{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a3e697e-af25-520f-9898-8d5bcb061010","task_key":"default--test--2320","task_revision_id":"1","upstream_id":"2320","short_description":"What does it mean if the heritability index for a particular trait ishigh?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The trait will be the same across all individuals regardless of their environment', '90% of the variance found in the scores in the population are attributable to environmental factors', 'The trait is entirely determined by environmental factors and has no genetic basis', 'Heritability index indicates that the trait cannot be passed down from generation to generation', 'Heritability index has no connection with genetic factors', '70% of the variance found in the scores in the population are attributable to genetic factors', 'The trait is not influenced by any external factors and is solely determined by genetics', 'Heritability index indicates the degree of modifiability of the trait', '50% of the variance found in the scores in the population is due to genetic factors and the other 50% to environmental factors', 'The heritability index for the trait is a fixed value and does not vary across populations']\",\"question\":\"What does it mean if the heritability index for a particular trait ishigh?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}