{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fa80d0dd-ed29-50eb-8885-33f484aa443b","task_key":"default--validation--26335","task_revision_id":"1","upstream_id":"26335","short_description":"HellaSwag validation 26335","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to copy aria montgomery's style without spending hardly anything [title] \\\" shop \\\" in your closet. [step] So first, make sure you have the right pieces. If you don't, a substitute is pretty easy to find, such as a denim jacket if you don't have a leather one lying around.\",\"endings\":\"[\\\"If you don't own a denim jacket, who know? Aria will use it and wear it casually over a t-shirt or jean jacket when she enjoys herself. [title] Wear a puppy key piercing if aria has one.\\\", \\\"So what are some staples of aria's style? [substeps] Black leather jacket. It's aria's signature, plus it really provides that edge.\\\", \\\"It's basically the same except that you have perfect fitted styles, ones worth just about anything. Maybe in yellow, pink, or cream? Chic is something aria really wants.\\\", 'Then you just have to add accessories like bangles, necklaces, bracelets, or whatever else aria has. Think about transferring the accessories, which will give aria a more realistic look.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}