{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e3e4994-4dbc-5480-8421-835cb4df5e53","task_key":"default--test--1090","task_revision_id":"1","upstream_id":"1090","short_description":"Four people own a property, and they agree to convey to an adult child of one of…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Yes, that is the risk the purchaser took; he cannot go to closing without a title search and a title company making arrangements for payment of the outstanding mortgage by the seller at closing.', 'Yes, but the court will also issue an order for the original four owners to pay a portion of the outstanding mortgage.', 'No, the court will order the purchaser to resume payments on the mortgage and to obtain a loan to pay it off within a reasonable time.', 'No, the court will order the bona fide purchaser to pay the outstanding mortgage.', 'Yes, because the court can only force the original four owners to clear the mortgage by paying it in full.', 'Yes, the court will dismiss the case because the purchaser did not conduct a title search before buying the property.', 'No, the court will order the adult child to resume paying on the mortgage and to obtain a loan to pay it off within a reasonable time.', 'No, the court will order the original four owners to come into court and defend on behalf of the adult child, who has no legal responsibility for the mortgage.', 'No, the court will order the adult child and the original four owners to equally share the remaining mortgage payments.', 'Yes, because the court can only force the adult child to clear the mortgage by paying it in full.']\",\"question\":\"Four people own a property, and they agree to convey to an adult child of one of them. There is a purchasemoney mortgage on the property for which the four signed a promissory note as security. The loan was not satisfied at the time of the conveyance. The conveyance is a deed in fee simple to the adult child. The adult child then takes over the mortgage payments. The adult child stops making the payments and conveys the property to a bona fide purchaser who does not do a title search. The purchaser sues his grantor to get an order compelling him to pay the mortgage and remove the lien from his property. Will the court more than likely grant the motion to dismiss made by the defendants?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}