{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f366bca-88e0-5b04-a50b-269ee48bd5bc","task_key":"all--test--1f366bca-88e0-5b04-a50b-269ee48bd5bc","task_revision_id":"1","upstream_id":"","short_description":"A consumer from State A filed a $100,000 products liabilityaction in federal…","config":"all","split":"test","body":"{\"choices\":\"['The court does not have subject-matter jurisdiction over the third-party complaint, because both the manufacturer and the designer are citizens of State B.', \\\"The manufacturer failed to obtain the court's leave to file the third-party complaint.\\\", \\\"The manufacturer's failure to follow the designer's speci-fications caused the flaw that resulted in the consumer's injuries.\\\", \\\"The manufacturer's third-party complaint failed to state a proper third-party claim.\\\"]\",\"question\":\"A consumer from State A filed a $100,000 products liabilityaction in federal court against a manufacturer incorporatedand with its principal place of business in State B. The con-sumer claimed that a flaw in the manufacturer's product had resulted in severe injuries to the consumer. In its answer,the manufacturer asserted a third-party complaint againstthe product designer, also incorporated and with its principal place of business in State B. Believing that the consumer had sued the wrong defendant, the manufacturer claimed boththat the designer was solely responsible for the flaw that had led to the consumer's injuries and that the manufacturer was not at fault. 7.After being fired, a woman sued her former employer in federal court, alleging that her supervisor had discriminated against her on the basis of her sex. The woman's complaint included a lengthy description of what the supervisor had said and done over the years, quoting his telephone calls and emails to her and her own emails to the supervisor's manager asking for help. The designer is aware that the manufacturer did not follow all of the designer's specifications when making the product. Which of the following arguments is most likely to achieve the designer's goal of dismissal of the third-party complaint?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}