{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"645c4214-7fb2-5bee-a58a-8277c15d496e","task_key":"default--test--1200","task_revision_id":"1","upstream_id":"1200","short_description":"Is the recognition of foreign judgments subject to the same rules as those…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Foreign judgments are enforced on the basis of the doctrine of monism', 'Foreign judgments are enforced on the basis of the doctrine of dualism', 'Foreign judgments are enforced on the basis of the doctrine of incorporation', 'The recognition of foreign judgments is dependent on the existence of appropriate bilateral or multilateral treaties', 'The courts exercise discretion as to the enforcement of foreign judgments on the basis of the rule of reciprocity', 'Foreign judgments are automatically recognized and enforced without any additional process.', 'Foreign judgments are enforced on the basis of the doctrine of transformation']\",\"question\":\"Is the recognition of foreign judgments subject to the same rules as those applicable to the incorporation and transformation of treaties?\",\"src\":\"ori_mmlu-international_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}