{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"663dd6d5-cd8e-5f80-b0e1-8ceb78b1b34c","task_key":"default--test--3237","task_revision_id":"1","upstream_id":"3237","short_description":"What is the major difference between themethodof swimming in a fish such as a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Both use side to side tail fin movement for swimming', 'Both species swim using rapid oscillation of their dorsal fins.', 'Tuna use their gills for propulsion while dolphins use their blowhole to aid in swimming.', 'Tuna swim by contracting their bodies and pushing water backwards, while dolphins swim primarily by using their pectoral fins.', 'Dolphins have a flexible backbone that allows for up-and-down movement, while tuna do not have a backbone.', 'Dolphins swim by rotating their entire body in a spiral motion, while tuna swim by flapping their fins only.', 'Tuna propel themselves using jet propulsion by expelling water, whereas dolphins glide through the water without any propulsion.', 'Dolphins use their hind limbs for swimming', 'In tuna, the tail fin is oriented dorso-ventrally and movement is side to side, while in dolphins, the tail fin is oriented laterally with dorso-ventral movement. Dolphins also have vestigial hind limbs and modified forelimbs for balance, unlike tuna.', 'Tuna have modified forelimbs for balance']\",\"question\":\"What is the major difference between themethodof swimming in a fish such as a tuna, and that of a dolphin?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}