{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a8607e5-0ab7-5652-a3a6-0110fcd41d09","task_key":"default--test--4366","task_revision_id":"1","upstream_id":"4366","short_description":"Although all electrons spin, only molecules containing unpairedelectrons - only…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Electron pairs have a net magnetic moment', 'Only electrons in the outermost shell contribute to the magnetic moment, regardless of pairing', 'Each electron of a pair has a unique magnetic moment', 'Free radicals lack electron pairs, which is why they cannot generate a magnetic moment', 'Electron pairs always spin in the same direction, enhancing the magnetic moment', 'Electron pairs generate a magnetic moment of the same magnitude', 'Electron pairs have spins that cancel only in the presence of an external magnetic field', 'Each electron of an electron pair generates a magnetic moment but of equal and opposite magnitude; the electron pair therefore has no net magnetic moment.', 'Electron pairs generate magnetic moments only at high temperatures', 'The magnetic moments of electron pairs reinforce each other, resulting in a double magnetic moment']\",\"question\":\"Although all electrons spin, only molecules containing unpairedelectrons - only free radicals - giveesrspectra. Why is this? (Hint: Consider the possibility (a)thatone electron of a pair has its spin reversed, or (b)thatboth electrons of a pair have their spins reversed.)\",\"src\":\"stemez-OrganicChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}