{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8f67edb-97dd-5720-9cf5-a6f10fe661c8","task_key":"default--test--3185","task_revision_id":"1","upstream_id":"3185","short_description":"Describe the function of the sea star's stomach as the animal feeds upon a clam.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"The sea star's stomach remains inside its body and absorbs nutrients directly from the water as the clam is digested externally.\\\", \\\"The sea star's stomach is used to capture prey by extending out and enveloping the entire clam.\\\", \\\"The sea star's stomach acts as a pump to forcefully open the clam's shell before ingestion.\\\", \\\"The sea star's stomach is used to filter out unwanted particles from the food.\\\", \\\"The sea star's stomach is used to grind the clam's shell into digestible pieces.\\\", \\\"The sea star's stomach produces light to distract the clam while other sea stars feed on it.\\\", \\\"The sea star's stomach secretes a strong acid to dissolve the clam's shell completely before ingestion.\\\", \\\"The sea star's stomach releases electrical charges to stun the clam before feeding.\\\", \\\"The sea star's stomach is used to store food for later consumption.\\\", \\\"The sea star's stomach is everted, enters the clam's shell, releases digestive enzymes to degrade the clam's body, and then retracts after eating.\\\"]\",\"question\":\"Describe the function of the sea star's stomach as the animal feeds upon a clam.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}