{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a0ca23b2-f160-5da4-a8ac-cae98959164d","task_key":"default--validation--18324","task_revision_id":"1","upstream_id":"18324","short_description":"HellaSwag validation 18324","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to order checks for the first time [title] Get checks from your bank. [step] You can always order checks directly from your bank. While these checks will likely have your bank logo instead of personalized checks, they are relatively easy to order directly through your bank.\",\"endings\":\"['[substeps] You should get a limited quantity of checks when you first open a checking account at your bank. If you plan on writing a lot of checks, you may want to order checks immediately at your bank when you open your account.', \\\"[substeps] To find your bank's logo, call 1-800-1021-6422, or check your bank's website. Make sure to have the check book that your bank gives you.\\\", \\\"[substeps] If your bank has a usps policy in place, you won't have to worry about finding the correct order online. You can usually order checks online from your bank's website.\\\", '[substeps] Check websites or look at the online marketplace for barcodes for checks. These will help you track your request or order through your bank.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}