{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e2d8a1a-1db4-5d04-ac74-6040ed6915fd","task_key":"default--validation--45037","task_revision_id":"1","upstream_id":"45037","short_description":"HellaSwag validation 45037","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to be a successful online student [title] Make sure you have reliable internet access. [step] One of the keys to succeeding in the online world is being able to reliably get online. Before signing up for an online course, make sure that you have regular opportunities to work online for several hours at a time.\",\"endings\":\"['It is best if you have high speed internet at your home. [substeps] Your campus likely has many computers with internet access that you can use.', 'This will help prevent bad habits like cold turkey and internet theft. [substeps] Service providers will also have free resources they can give you resources for in-person courses available at your university.', \\\"[substeps] Be sure that you can work through the good times ahead of time by interviewing people you know at a site like lansurezoned. Find out what your target audience is and get those people's feedback so that you are willing to be on your game.\\\", \\\"This will help ensure that you don't waste time while working out and in the middle of a meeting. [substeps] You can meet online students on social media or other websites where you can deliver hands-on updates on their free time.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}