{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d82f115d-589b-5030-9e6e-2b77f94f59cc","task_key":"default--test--1760","task_revision_id":"1","upstream_id":"1760","short_description":"In what way is Responsibility to Protect (R2P) different from humanitarian…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['R2P is less arbitrary because it requires some UNSC input and its primary objective is to avert a humanitarian crisis', 'R2P always involves economic sanctions, whereas humanitarian intervention does not', 'R2P is essentially the same as humanitarian intervention', 'R2P requires a call for assistance by the State in distress', 'R2P always involves armed force, whereas humanitarian intervention does not', 'Humanitarian intervention is essentially the same as R2P', 'Humanitarian intervention always requires UNSC approval while R2P does not', 'Humanitarian intervention requires a call for assistance by the State in distress while R2P does not', 'R2P is more arbitrary because it does not require UNSC input', 'R2P is a broader concept that includes economic sanctions, whereas humanitarian intervention is strictly military']\",\"question\":\"In what way is Responsibility to Protect (R2P) different from humanitarian intervention?\",\"src\":\"ori_mmlu-international_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}