{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eca7afb4-4050-56fb-922b-78dbe3409b47","task_key":"default--validation--48162","task_revision_id":"1","upstream_id":"48162","short_description":"HellaSwag validation 48162","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to report fraud in canada [title] Gather as much information as possible. [step] Organize and preserve any evidence you have of the fraudulent activity, including emails, receipts, screen captures, or phone records. If possible, try to print digital files, but keep the digital file on your computer or device.\",\"endings\":\"['[substeps] Make sure you thoroughly research the fraudulent activity in the or your computer and document it closely. If you find out that someone has been involved, you may need to submit a report to the canadian security administration.', 'If necessary, you may also want to distribute copies or files to all major credit reporting agencies. [substeps] Purchase or post copies of any receipts or other supporting documentation to any credit reporting agencies, such as financial statements, paid bills, or receipts from friends, family, or credit card purchases.', \\\"[substeps] If you can't hire a lawyer, particularly if the fraud involves financial problems, try to hire a financial advisor. Not only can this save you substantial amounts of time, but the legal cost of hiring a financial advisor can impact the fees associated with filing your report.\\\", \\\"[substeps] Focus on evidence you can easily acquire yourself, such as from your own records or accounts. Don't put yourself in potential danger by provoking the fraudster or attempting to play detective.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}