{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba596239-b180-5d1d-8bd6-ea20d9d8eca3","task_key":"default--test--3373","task_revision_id":"1","upstream_id":"3373","short_description":"By photographic and optical means, an image can be enlarged almost indefinitely.…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The resolution offered by electron microscopes is more than a thousandfold better than light microscopes.', 'Electron microscopes are less expensive and more accessible than light microscopes', 'Light microscopes have a more complex setup and calibration process than electron microscopes', 'Light microscopes provide a deeper depth of field than electron microscopes', 'Electron microscopes require specimens to be in a vacuum, which limits the type of specimens that can be observed', 'Light microscopes can magnify live specimens, whereas electron microscopes cannot', 'Electron microscopes use light waves, while light microscopes use electron beams', 'Light microscopes use shorter wavelength radiation', 'Electron microscopes have a larger magnification range', 'Electron microscopes are easier to use']\",\"question\":\"By photographic and optical means, an image can be enlarged almost indefinitely. However, most light microscopes offer magnifications of only 1000 to 1500 times the actual size, while electron microscopes offer magnifications of 100,000 times or more. Explain.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}