{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a68efe5-f569-5be5-b6d9-f1145a568462","task_key":"default--test--1904","task_revision_id":"1","upstream_id":"1904","short_description":"A businessman is the owner of a pet products company, which is engaged in the…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['the breeder, because the businessman failed to notify the breeder about the high-frequency sound waves.', \\\"the businessman, because the breeder's business is abnormally sensitive to harm caused by the high-frequency sound waves.\\\", 'the businessman, because the breeder came to the nuisance after his factory had already been in operation for a number of years.', 'the breeder, because the businessman intentionally did not inform about the high-frequency sound waves.', 'the breeder, because the businessman is manufacturing a product that is causing harm to her business.', 'the businessman, because the high-frequency sound waves do not harm people or the environment.', 'the breeder, because the high-frequency sound waves constitute a trespass to her premises.', 'the businessman, because the breeder should have soundproofed her kennel.', 'the businessman, because the breeder should have done a thorough investigation before purchasing the property.']\",\"question\":\"A businessman is the owner of a pet products company, which is engaged in the manufacture and sale of a variety of pet supplies. The businessman's company manufactures such products as pet furniture, toys, beds, collars, leashes, cages, and vitamins. These items are distributed to pet stores throughout the United States and Europe. For many years, the company has conducted its operations from a large factory located in a small town in the southern part of the state. One of the businessman's biggest selling products is specially manufactured high-frequency dog-calling whistles. These whistles are sold to dog-training schools and canine divisions of many police departments. Although these whistles are not audible to people, they are audible to dogs over considerable distances. Two years ago, a breeder purchased an undeveloped lot in the small town in which the company's factory was located. On her property, the breeder constructed a pet hotel, which was used as a boarding kennel for dogs and cats. This boarding facility was situated about 100 yards from the company's factory. Unknown to the breeder, high-frequency sound waves often emanated from the company's factory when dog-calling whistles were being tested. These sound waves caused the breeder's dogs to howl uncontrollably for many hours during the day and seriously interfered with the operation of her business. The breeder now brings an action against the businessman and the company to recover damages for the interference with her business caused by the high-frequency sound that reaches her kennel. The court should rule in favor of\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}