{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f5a6b61c-f8eb-5af2-8d83-4cc53f179ea5","task_key":"default--validation--36616","task_revision_id":"1","upstream_id":"36616","short_description":"HellaSwag validation 36616","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to connect kindle to tv [title] Purchase amazon fire tv. [step] Obtain an amazon fire tv stick or an amazon fire tv box from your local electronics store or online. You may connect to kindle if you purchase fire models hd6 or 7, hdx or hdx 8.9, hd8 or hd10, or hd 2nd generation.\",\"endings\":\"[\\\"[substeps] An amazon fire tv stick connects to your tv's hdmi port and has a dual-core processor and 1 gb of memory. It allows you to watch over 250 , 000 episodes of tv and movies as well as provides games and music.\\\", 'For more on amazon television, see how to connect kindle to tv : [substeps] Insert the kindle shifter into the driver compartment of your kindle pc. Tap the \\\" login \\\" button on the top of the screen to continue.', 'The kernel or fire are used exclusively for theater performances. [substeps] Make sure you spend an appropriate amount of money on an amazon tv.', 'Select hd6 or 7 if you purchase hd11 or 7 generation. The hd12 network has thirty hd12 tv options for you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}