{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"717727c5-c6ea-5a7e-a70f-31ee7a57ca35","task_key":"default--test--3064","task_revision_id":"1","upstream_id":"3064","short_description":"In what ways are bacteria useful to the dairy industry?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Bacteria are used to change the color of dairy products', 'Bacteria are used in the dairy industry for the production of fermented milk products, butter, and different types of cheeses. They also help certain milk-giving animals acquire nutrients by breaking down cellulose from ingested plant material.', 'Bacteria are employed in the production of non-dairy milk substitutes like almond or soy milk.', 'Bacteria are used to artificially inflate the volume of dairy products.', 'Bacteria are utilized for increasing the fat content of milk artificially.', 'Bacteria are used to convert lactose to high-fructose corn syrup in dairy products.', 'Bacteria are used to improve the shelf life of dairy products', 'Bacteria are used to synthesize artificial dairy flavors for use in non-dairy products.', 'Bacteria are used in the dairy industry for pasteurization', 'Bacteria are utilized to solidify liquid milk into a gel-like substance for specialized dairy products.']\",\"question\":\"In what ways are bacteria useful to the dairy industry?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}