{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4451a153-e74c-55c4-87f3-a2236b87fdeb","task_key":"default--test--2800","task_revision_id":"1","upstream_id":"2800","short_description":"List and describe Freud's stages of motivational development.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"The six stages of Freud's motivational development are: the oral phase, the anal phase, the phallic phase, a latency period, the genital phase, and the transcendence phase.\\\", 'The five stages are: the sensory phase, the muscular phase, the phallic phase, a latency period, and the genital phase.', \\\"The five stages of Freud's motivational development are: the oral phase, the anal phase, the phallic phase, a latency period and the genital phase.\\\", 'The five stages are: the oral phase, the anal phase, the conscious phase, a latency period and the genital phase.', 'The five stages are: the oral phase, the anal phase, the phallic phase, a latency period and the unconscious phase.', \\\"The five stages of Freud's motivational development are: the ingestion phase, the retention phase, the phallic phase, a latency period, and the maturity phase.\\\", 'The five stages are: the oral phase, the ego phase, the id phase, a latency period and the genital phase.', 'The four stages are: the oral phase, the anal phase, the latency phase, and the genital phase.', 'The five stages are: the oral phase, the anal phase, the oedipal phase, a latency period, and the adolescent phase.', 'The seven stages are: the oral phase, the anal phase, the phallic phase, the latency period, the genital phase, the ego phase, and the superego phase.']\",\"question\":\"List and describe Freud's stages of motivational development.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}