{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74971056-410d-5cab-965b-46bb499eacb7","task_key":"default--test--7997","task_revision_id":"1","upstream_id":"7997","short_description":"7.5-1. Let $Y_1 < Y_2 < Y_3 < Y_4 < Y_5 < Y_6$ be the order statistics of a…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['0.7137', '0.8426', '0.6561', '0.8750', '0.9000', '0.5000', '0.6214', '0.3125', '0.9453', '$0.7812$']\",\"question\":\"7.5-1. Let $Y_1 < Y_2 < Y_3 < Y_4 < Y_5 < Y_6$ be the order statistics of a random sample of size $n=6$ from a distribution of the continuous type having $(100 p)$ th percentile $\\\\pi_p$. Compute\\n(a) $P\\\\left(Y_2 < \\\\pi_{0.5} < Y_5\\\\right)$.\",\"src\":\"scibench-stat\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}