{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97602c38-b1a6-5e9c-b2c3-8ea3af7e7176","task_key":"default--test--11085","task_revision_id":"1","upstream_id":"11085","short_description":"Against Kant's view of sexual objectification, Papadaki argues that","config":"default","split":"test","body":"{\"category\":\"philosophy\",\"options\":\"[\\\"Papadaki actually agrees with Kant's view\\\", \\\"Papadaki suggests that Kant's view of sexual objectification is too subjective.\\\", 'Papadaki argues that sexual objectification is an outdated concept.', 'sexual objectification actually enhances humanity.', 'Papadaki believes that sexual objectification is a necessary part of human relationships.', \\\"Papadaki argues that Kant's view of sexual objectification is too moralistic.\\\", \\\"According to Papadaki, Kant's views on sexual objectification are too black and white.\\\", 'Papadaki holds that sexual objectification can be justified in certain contexts.', 'Kant is wrong to think about the wrong of sexual objectification in terms of humanity.', 'it is not clear how sexual use sacrifices humanity.']\",\"question\":\" Against Kant's view of sexual objectification, Papadaki argues that\",\"src\":\"ori_mmlu-moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}