{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0985e484-13b0-5d5d-b49d-5e5136655da6","task_key":"default--test--2300","task_revision_id":"1","upstream_id":"2300","short_description":"Why do different individuals develop diverse symptomsfor similarproblems?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Psychologists have developed three basic hypotheses to account for the process of symptom selection: the learning hypothesis, the genetic hypothesis, and the developmental stage hypothesis.', 'Symptoms are chosen by the individual consciously as a means of communication', 'Symptom differences are a result of the alignment of stars at the time of the individual’s birth', \\\"Symptoms are influenced by the individual's diet and exercise routine only\\\", \\\"Symptom variation is entirely determined by the individual's current environment and situation\\\", 'Symptoms are randomly selected', 'Symptoms are predetermined at birth and unchangeable throughout life', 'Symptom selection is solely based on genetics', 'The severity of symptoms is the only aspect that differs between individuals, not the symptoms themselves', \\\"Symptom diversity is due to individual's personal experiences\\\"]\",\"question\":\"Why do different individuals develop diverse symptomsfor similarproblems?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}