{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ce57ab6b-0562-5896-ad11-704a58f624ff","task_key":"default--validation--19322","task_revision_id":"1","upstream_id":"19322","short_description":"HellaSwag validation 19322","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to use netflix codes [title] Find the most recent list of codes. [step] Netflix has a very long list of four to six digit codes that help you browse for very specific types of films. The list of codes is changing all the time, so type in \\\" netflix codes \\\" into a search engine to find the most recent list.\",\"endings\":\"['[substeps] Since netflix is an online dating service, it uses massive numbers of codes that you can enter to find the right type of film and series. For instance, several countries have netflix codes with a specific name, such as canada, africa, england, or philadelphia.', \\\"[substeps] The sites what's on netflix and netflixcodes.me keep updated lists of codes. [title] Browse the codes to find a movie genre.\\\", '[substeps] You can get a zip code from the packet. Most servers have a sticker you can paste to the package text field at the top of the netflix netflix web page.', '[substeps] The codes for new york codes are listed by city, state, country and country, so finding them will help you easily find variety of codes. [title] Enter all the codes into your local lock store.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}