{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd9ae749-ed96-549a-8256-25b6706f6a85","task_key":"default--validation--7621","task_revision_id":"1","upstream_id":"7621","short_description":"HellaSwag validation 7621","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to avoid going to court when filing for bankruptcy [title] Wait several months before you file. [step] Ideally, wait at least three to four months after you decide you want to file for bankruptcy to actually file. You can control your financial behavior and avoid questionable transactions that might cause problems with your bankruptcy case.\",\"endings\":\"['For example, you might choose to file for bankruptcy on the same date as you would when filing for chapter 7 bankruptcy. These dates should not affect how much you can collect after you file.', \\\"This preparation will allow you to move ahead and take a heartening look at your debts. [substeps] It's best to wait at least a year between after you file your bankruptcy petition and the date at which you file for bankruptcy.\\\", '[substeps] You can have your bankruptcy case one step ahead of its deadline. The waiting period can seem longer than it actually is, and depending on the length of time you choose to wait, different operations and deadlines can affect the amount of time you wait.', \\\"[substeps] In some situations, such as if you're trying to prevent an imminent wage garnishment, you may not have this luxury. If you're getting behind on your bills and experiencing significant financial stress, speak to a financial professional or credit counselor as soon as possible.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}