{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a3f82768-4e66-5184-8b98-bfbb43e33710","task_key":"default--test--10908","task_revision_id":"1","upstream_id":"10908","short_description":"What is the main reason why Arthur doesn't think that the poor have a right to…","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"['Arthur believes that the provision of aid undermines the principles of free-market capitalism.', \\\"This kind of right would require a contract or agreement, and the affluent haven't entered into a contract or agreement with the poor.\\\", 'The consequences of helping the poor would be worse than the consequences of not helping them.', 'The right to aid is a negative right.', \\\"Arthur contends that the concept of 'rights' is subjective and can't be universally applied.\\\", 'Arthur believes that the affluent have earned their wealth and should not be obligated to share it.', 'Arthur believes that aid should only be given voluntarily, not out of obligation.', 'Arthur thinks that aid only perpetuates poverty and does not solve the root cause.', 'The poor are responsible for their own situation, according to Arthur.', 'Persons can never have a right to aid from anyone.']\",\"question\":\" What is the main reason why Arthur doesn't think that the poor have a right to aid from the affluent?\",\"src\":\"ori_mmlu-moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}