{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61d7eb7d-c5ed-591f-99e0-7db7dc3f044f","task_key":"default--test--10672","task_revision_id":"1","upstream_id":"10672","short_description":"Given image \\begin{tabular}{|llll|} \\hline 7 & 1 & 6 & 0 \\\\ 3 & 3 & 7 & 6 \\\\ 6 &…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['4', '6', '8', '9', '1', '7', '5', '2', '3', '0']\",\"question\":\"Given image \\\\begin{tabular}{|llll|} \\\\hline 7 & 1 & 6 & 0 \\\\\\\\ 3 & 3 & 7 & 6 \\\\\\\\ 6 & 6 & 5 & 7 \\\\\\\\ \\\\hline \\\\end{tabular} , and the bit-depth of the image is 4. Suppose you want to use the thresholding technique to segment the image. What is the appropriate threshold value based on the histogram of the image? Follow the following rule when you do thresholding or grouping: pixel $(i, j) \\\\in$ Group A pixels if $g(i, j) \\\\leq$ current threshold $\\\\mathrm{T}$; pixel $(i, j) \\\\in$ Group B pixels otherwise, where $g(i, j)$ is the intensity value of pixel $(i, j)$.\",\"src\":\"theoremQA-EECS\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}