{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09846833-0719-5463-9bf7-4f9a848af7f9","task_key":"default--test--1915","task_revision_id":"1","upstream_id":"1915","short_description":"On April 10, the owner of a golf course entered into an oral agreement with a…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The gardener could not provide a warranty for the installation.', 'The gardener was not insured to carry out the task.', 'Half of the sprinkler heads installed by the gardener were determined to be defective, and the gardener refused to replace the sprinkler heads.', 'The owner found a cheaper alternative to complete the job.', 'The gardener was using subpar materials for the installation.', 'The gardener had been adjudicated bankrupt onApril 12.', 'The gardener had only completed 33 percent of the installation work when he was discharged.', 'The contract between the owner and the gardener was not in writing.', 'The gardener did not have a valid license to do the job.', 'The gardener failed to finish the job by April 19.']\",\"question\":\"On April 10, the owner of a golf course entered into an oral agreement with a gardener whereby the gardener promised to install all new sprinkler heads on the sprinkler system at the 18-hole golf course. In return, the owner promised to pay the gardener $2,400 upon completion of the job. Since a golf tournament was scheduled for the weekend of April 20 €”21, the gardener agreed to replace all the sprinkler heads no later than April 19. Before accepting the job, the gardener had inspected the golf course and determined that 240 sprinkler heads had to be replaced. By April 14, the gardener had installed 80 new sprinkler heads on the first six holes of the 18-hole golf course. That afternoon, however, the owner learned that the gardener had been adjudicated bankrupt on April 12, so he notified the gardener to discontinue the job. The next day, the owner hired a landscaper to complete the installation work at $8 per head. The landscaper installed the remaining 160 sprinkler heads and completed the work on April 19. Despite making reasonable efforts, the gardener was unable to find any gainful employment during the period. Also, the gardener's application for unemployment compensation was rejected at the same time. Which of the following statements, if found to be true, would provide the owner with legally justifiable grounds for discharging the gardener?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}