{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e466aea0-93e3-564a-b5c2-52ed65d49b88","task_key":"default--validation--34925","task_revision_id":"1","upstream_id":"34925","short_description":"HellaSwag validation 34925","config":"default","split":"validation","body":"{\"activity_label\":\"Travel\",\"ctx\":\"[header] How to get a free room upgrade in las vegas [title] Visit vegas at the right time. [step] The dates of your visit to vegas may increase your chances of receiving a free room upgrade. Travel experts, however, have conflicting opinions on the \\\" right time \\\" to visit vegas.\",\"endings\":\"[\\\"[substeps] It's highly likely that your hotel will provide a free room upgrade for several days prior to the date of your visit. However, las vegas law states that about 30 days before you visit, when a party or other event places a hotel upgrade fee as a matter of course, at 100.00.\\\", '[substeps] Visit during a period of low occupancy. According to some travel experts, if you want a free upgrade, reserve a room during a period of low-occupancy.', 'The only person who can confirm a free room upgrade is you-and only you. Keep in mind that visitors to vegas may not agree to a free room upgrade just yet, though, so it may be a good idea to bring along helpful travel proof documents to prove your case and correct any misconceptions.', \\\"To prevent this from happening, get your bearings on the weekend before your visit so you don't miss any opportunities to adventure. [title] Search online to find the free ballroom's features and typical number of rooms remaining on the school spectrum.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}