{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7093a2f-c19b-5503-b34b-abb9ee08c634","task_key":"default--validation--14020","task_revision_id":"1","upstream_id":"14020","short_description":"HellaSwag validation 14020","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make vaporwave [title] Figure out what subgenre of vaporwave you want to do. [step] There isn't a real vaporwave, it's more a couple of sub-genre one derives from another. You can find out more about each one by researching vaporwave subreddit wiki.\",\"endings\":\"['Some vaporwave sites have \\\" jamital \\\" discussion websites. You can also try splitting your library into dedicated subgenres.', \\\"[title] Browse the internet for some 70's , 80's , 90's music. [step] This is the most common music sampled in vaporwave.\\\", '[substeps] If you want to specify a genre, go to the \\\" grammar and punctuation \\\" section of the article, say \\\" vaporwave \\\". This will take you to step number 1 and take you to the next page.', 'You can also take inspiration from movies like corollo, ray of lantern, and tolkien vaporwave, and settle on a sub-genre that will be complete for you. Some examples would be : [substeps] Anime & anime/horror flick 1999-always.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}