{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"48480d47-7216-522b-8ff1-ff6fbc44db4a","task_key":"default--validation--2585","task_revision_id":"1","upstream_id":"2585","short_description":"HellaSwag validation 2585","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to avoid violating your b2 tourist visa [title] Find your deadline for leaving. [step] The deadline won't actually be on your visa. However, it should be noted on the admission stamp placed in your passport.\",\"endings\":\"['You may not be approved to go outside of those dates. [substeps] Other countries may have different dates on their admission schedules.', 'This interval could be stamped as two months or as a year, depending on how long you had checked your passport periodically. [substeps] The specific deadline would differ by country, but generally, the deadline is two years.', '[substeps] For example, you might not leave for four weeks before your t1 visa expires. If so, the waiting period could make the trip harder.', 'You can also find the deadline on your arrival/departure form i-94. You can get the form in the following ways : [substeps] If you entered the united states by land port, then you should be given a paper copy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}