{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80adb9ea-1c25-5a17-ae2d-ec1eaf3358e6","task_key":"default--test--12160","task_revision_id":"1","upstream_id":"12160","short_description":"Find the 10 percent and 60 percent depth of penetrations of an electromagnetic…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['10 percent depth of penetration is 0.3\\\\\\\\delta, 60 percent depth of penetration is 1\\\\\\\\delta', '10 percent depth of penetration is \\\\\\\\delta, 60 percent depth of penetration is 3\\\\\\\\delta', '10 percent depth of penetration is 2.3\\\\\\\\delta, 60 percent depth of penetration is 0.51\\\\\\\\delta', '10 percent depth of penetration is 0.1\\\\\\\\delta, 60 percent depth of penetration is 0.6\\\\\\\\delta', '10 percent depth of penetration is 0.1\\\\\\\\delta, 60 percent depth of penetration is 0.3\\\\\\\\delta', '10 percent depth of penetration is 1.23\\\\\\\\delta, 60 percent depth of penetration is 0.56\\\\\\\\delta', '10 percent depth of penetration is 3\\\\\\\\delta, 60 percent depth of penetration is 1.8\\\\\\\\delta', '10 percent depth of penetration is 0.51\\\\\\\\delta, 60 percent depth of penetration is 2.3\\\\\\\\delta', '10 percent depth of penetration is 1.5\\\\\\\\delta, 60 percent depth of penetration is 0.9\\\\\\\\delta', '10 percent depth of penetration is 0.23\\\\\\\\delta, 60 percent depth of penetration is 1.2\\\\\\\\delta']\",\"question\":\"Find the 10 percent and 60 percent depth of penetrations of an electromagnetic wave of amplitude E_y= E_0e^-x/\\\\delta (E_0 is initial amplitude) traveling in the x-direction.\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}