{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc849196-0504-537e-a581-2596110e13c9","task_key":"default--validation--42749","task_revision_id":"1","upstream_id":"42749","short_description":"HellaSwag validation 42749","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to file a civil lawsuit in illinois [title] Send a demand letter. [step] Before you take the time and effort to file a lawsuit, you might attempt to settle the dispute with the person you want to sue. [substeps] Send a written letter to the person or business describing your claim, and explaining your remedies under illinois state law.\",\"endings\":\"['Stick to the facts of the dispute, and avoid emotional language or personal insults. Give the person a deadline to respond, and indicate that you are prepared to file suit if your demand is not met.', 'Describe the incident that gave rise to your claim and explain why you are not willing to settle. Identify the person or business that you want to sue, and be sure to briefly describe why you disagree with their position.', 'Send a \\\" summons \\\" or \\\" notice \\\" or other form of proof to the person you want to sue. The person must be served with your letter.', 'The person or business you file with should be given the opportunity to respond, so do not get mad if they ignore your claim. In illinois, you do not owe a right to file a lawsuit unless you send a demand letter.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}