{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"238decd4-aa9a-5a61-a28c-4984b6441421","task_key":"default--test--74","task_revision_id":"3","upstream_id":"74","short_description":"Some of key differences between Islamic finance and conventional finance include…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Interest, Certain, Assured, Both tangible and intangible assets', 'Interest, Uncertain, Assured, Both tangible and intangible assets', 'Interest, Uncertain, Speculative, Intangible assets', 'Interest, Certain, Assured, Tangible assets', 'Interest, Uncertain, Assured, Intangible assets', 'Profit, Uncertain, Speculative, Tangible assets', 'Interest, Uncertain, Speculative, Tangible assets', 'Interest, Certain, Speculative, Intangible assets', 'Profit, Certain, Assured, Tangible assets', 'Interest, Certain, Speculative, Both tangible and intangible assets']\",\"question\":\" Some of key differences between Islamic finance and conventional finance include - prohibition of charging and paying _______, prohibition on ______ and ______ transactions, prohibition of sinful investment and requirement for all financial products to be backed by __________.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}