{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c633c4d-181a-5833-ab51-a1f39f4e0eaf","task_key":"default--test--1867","task_revision_id":"1","upstream_id":"1867","short_description":"A man hired a videographer to film his daughter's wedding. The written contract…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The contract is open to interpretation and does not explicitly state that use of high definition equipment would be included in the $10,000 fee.', 'The use of high definition equipment is a separate service and not included in the base fee for filming and editing.', 'According to the customary trade practice of the video industry, a $10,000 fee for filming and editing means $10,000 in addition to a supplemental charge if high definition equipment is used.', 'An oral agreement to that effect, if provable, would only supplement, not contradict, the \\\"payment clause\\\" as written.', \\\"The man's stipulation for high definition equipment implies agreement to additional charges associated with the use of such equipment.\\\", 'The videographer can provide evidence of past clients who were charged separately for the use of high definition equipment.', 'Assuming arguendo that the written \\\"payment clause\\\" was fully integrated and neither patently nor latently ambiguous, equitable considerations require admission of extrinsic evidence, if available, of the parties\\\\' intent, since the videographer would stand to lose $5,000 on the contract.', 'Under the UCC, extrinsic evidence, if available, of additional terms agreed to by the parties is admissible unless such terms \\\"would certainly vary or contradict those contained in the document. \\\"', 'The videographer had previously informed the man of the additional costs of using high definition equipment.', 'The videographer provided a service above and beyond the agreed upon terms, therefore justifying the additional cost.']\",\"question\":\"A man hired a videographer to film his daughter's wedding. The written contract entered included a \\\"payment clause,\\\" which provided that the videographer would be \\\"paid $10,000 for the filming and editing of a 60-minute video of the wedding and the reception. \\\" The man included in the contract a stipulation that the video would be filmed using high definition equipment. The contract made no other reference to compensation. Thereafter, the videographer filmed and edited the 60-minute video, using high definition equipment, and presented it to the man. The videographer then submitted to the man an invoice statement in the amount of $15,000. Besides the $10,000 contract figure, the bill included a $5,000 charge for the use of the high definition equipment. Denying any additional liability, the man sent the videographer a check for $10,000. The videographer then brought suit against the man to recover the additional $5,000. Which of the following arguments would be most persuasive to support the videographer's contention that when the written contract was executed, the man agreed to pay the videographer $5,000 for use of the high definition equipment in addition to the $10,000 fee?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}