{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4fa3652e-a42e-5159-a437-bb260a4d9f23","task_key":"default--test--1833","task_revision_id":"1","upstream_id":"1833","short_description":"In a jurisdiction using the grantor €”grantee indices, the following events have…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The mortgage company has a cause of action against both the woman and the daughter.', 'The daughter has a cause of action against the mortgage company.', 'Neither the daughter nor the mortgage company has a cause of action against the woman.', 'Only the mortgage company has a cause of action against the woman.', 'Both the daughter and the mortgage company have causes of action against the woman.', 'The woman has a cause of action against the mortgage company.', 'The mortgage company and the daughter share a cause of action against the woman.', 'Only the daughter has a cause of action against the woman.', 'Both the woman and the daughter have causes of action against the mortgage company.', 'The woman has a cause of action against the daughter.']\",\"question\":\"In a jurisdiction using the grantor €”grantee indices, the following events have occurred in the order listed below:(1) In 1993, a woman mortgaged a tract of land to a mortgage company to secure a note for $25,000, due on December 31, 1993, with 9'/2 percent interest per annum. (2) In 1996, the mortgage company recorded the mortgage on the tract of land. (3) In 2007, in a signed writing, which the woman delivered to her daughter, the woman promised to convey the tract of land to her daughter by quitclaim deed and pay the mortgage debt when it came due. (4) In 2008, the woman delivered to the daughter a quitclaim deed that made no reference to the mortgage. If the woman thereafter defaulted on the mortgage debt, which of the following is probably correct?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}