{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92a013d5-eb63-5643-93a4-e4b637ac025b","task_key":"default--test--2679","task_revision_id":"1","upstream_id":"2679","short_description":"What are three factors that influence the intensity of a taste? Explain.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Nutritional content, method of food storage, and time since last meal', 'Type of utensil used, color of the food, and texture of the food', 'Temperature of the food, age of the person, and presence of smell', 'Height above sea level, time of year, and brand of food', 'Food pairing, cultural background, and time of consumption', \\\"Presence of visual stimuli, ambient temperature, and individual's health condition\\\", \\\"Concentration of the stimulus, area of the tongue's surface that is stimulated, and other tastes present at the same time\\\", \\\"Cooking method, individual's mood, and the sound environment\\\", \\\"Type of food, time of the day, and individual's hunger level\\\", 'Genetic makeup of the individual, color of the plate, and serving size']\",\"question\":\"What are three factors that influence the intensity of a taste? Explain.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}