{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f546cb1b-df47-5ad9-91d1-e35142963b23","task_key":"default--test--9417","task_revision_id":"1","upstream_id":"9417","short_description":"A horizontal spring-block oscillator is in motion when a second block of equal…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['It would depend on where the original block was in its cycle when the second block fell.', 'It will have no effect.', 'It would depend on the velocity of the second block.', 'It will cause the oscillation to become irregular.', 'It will decrease the amplitude.', 'It will halve the amplitude.', 'The amplitude will increase or decrease depending on the phase of the oscillation.', 'It will double the amplitude.', 'It will cause the oscillation to stop.', 'It will increase the amplitude.']\",\"question\":\"A horizontal spring-block oscillator is in motion when a second block of equal mass falls on top of the oscillating block. If the two blocks stick together, what effect will this have on the amplitude of the oscillations?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}