{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d652356d-e0b3-510b-8197-0d3181189317","task_key":"default--validation--7324","task_revision_id":"1","upstream_id":"7324","short_description":"HellaSwag validation 7324","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to defend yourself in an online data breach lawsuit [title] Read the complaint. [step] A lawsuit is started when the plaintiff files a complaint and serves it on you (the defendant). A complaint contains the allegations against you, the relief sought, and other technical information telling the court that the lawsuit is permissible (e.g., standing).\",\"endings\":\"['If you are served with a complaint, read it carefully and plan your next move. [substeps] The complaint will likely allege that you or your company in some way acted negligently or breached some fiduciary duty you owed to the plaintiff.', 'If you have information being flamored in court that you want to undermine, then you should read the complaint. [substeps] The complaint might be regarding the company that provided the data the plaintiff claims was harmful.', \\\"You should find the complaint and its claim form. [substeps] If you don't have access to a copy of the complaint, then you don't have much to prove.\\\", 'The plaintiff shows that you have breached the only protection your personal property would have provided before you are injured. To prove this, the complaint contains a strong argument that is alleging you were not protected in an online breach.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}