{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e08fd354-5552-5dbf-8973-47810dadfa09","task_key":"default--test--2874","task_revision_id":"1","upstream_id":"2874","short_description":"Distinguish between the terms \"in situ,\\textquotedblright \"in vitro,\" and…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['\\\"In situ\\\" refers to reactions in a laboratory setting. \\\"In vitro\\\" refers to reactions in the body of a living organism. \\\"In vivo\\\" refers to reactions observed in a natural setting but not within a living organism.', '\\\"In situ\\\" refers to reactions that are artificially induced. \\\"In vitro\\\" refers to reactions that occur naturally within a living organism. \\\"In vivo\\\" refers to reactions studied in a laboratory environment.', '\\\"In situ\\\" refers to reactions in a test tube. \\\"In vitro\\\" refers to reactions in the living organism. \\\"In vivo\\\" refers to reactions in their original position.', '\\\"In situ\\\" refers to reactions that occur in an artificial organism. \\\"In vitro\\\" refers to reactions that take place in a natural environment. \\\"In vivo\\\" refers to reactions that are simulated using computer models.', '\\\"In situ\\\" refers to reactions in a living organism that has been modified. \\\"In vitro\\\" refers to reactions in their natural position. \\\"In vivo\\\" refers to reactions in a test tube or artificial setting.', '\\\"In situ\\\" refers to reactions in a controlled laboratory environment. \\\"In vitro\\\" refers to reactions in a natural setting. \\\"In vivo\\\" refers to reactions in a computational simulation.', '\\\"In situ\\\" is a reaction that occurs in its natural or original position. \\\"In vitro\\\" is a reaction that occurs in a laboratory such as a test tube. \\\"In vivo\\\" is a reaction that occurs in the living organism.', '\\\"In situ\\\" refers to reactions in the living organism. \\\"In vitro\\\" refers to reactions in a test tube. \\\"In vivo\\\" refers to reactions in their original position.', '\\\"In situ\\\" refers to reactions occurring in the living organism. \\\"In vitro\\\" refers to reactions in their original position. \\\"In vivo\\\" refers to reactions in a test tube.', '\\\"In situ\\\" refers to reactions that occur in a virtual environment. \\\"In vitro\\\" is a reaction that occurs in a living organism. \\\"In vivo\\\" is a reaction that occurs outside of a biological context.']\",\"question\":\"Distinguish between the terms \\\"in situ,\\\\textquotedblright \\\"in vitro,\\\" and \\\"invivo.\\\"\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}