{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81d46bfc-dae5-53cb-997e-8de15d813461","task_key":"default--test--5656","task_revision_id":"1","upstream_id":"5656","short_description":"Which of the following most accurately states the impact of the Civil Rights Act…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The Civil Rights Act of 1964 mandated a quota system for racial representation in all Southern public schools.', 'The Civil Rights Act of 1964 immediately desegregated all schools in the South.', 'Because it included no enforcement provisions, the Civil Rights Act of 1964 had no appreciable effect on school desegregation.', 'The Civil Rights Act of 1964 made it illegal to segregate schools but did not provide any means for enforcement.', 'The Civil Rights Act of 1964 only impacted desegregation in universities, not in primary and secondary schools.', 'By overturning the \\\"separate but equal\\\" principle, the Civil Rights Act of 1964 ended segregation in public schools.', 'The Civil Rights Act of 1964 increased segregation in schools due to backlash against the legislation.', 'The Civil Rights Act of 1964 sent federal troops to every segregated public school in the South to force school desegregation.', 'The Civil Rights Act of 1964 hastened school desegregation by cutting off federal funds to discriminatory school systems.', 'The Civil Rights Act of 1964 had no direct impact on school desegregation, but provided a basis for future legislation.']\",\"question\":\"Which of the following most accurately states the impact of the Civil Rights Act of 1964 on school desegregation in the South?\",\"src\":\"ori_mmlu-high_school_government_and_politics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}