{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18017ea9-6752-50c8-a121-6cf91bf52153","task_key":"default--validation--34580","task_revision_id":"1","upstream_id":"34580","short_description":"HellaSwag validation 34580","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to dress casually [title] Avoid clothes that are too tight. [step] You don't have to wear clothes that are super-baggy, but tight-fitting clothes can make you look uncomfortable, defeating the purpose of casual wear. [substeps] Form-fitting dresses or tight pants are more suitable for a night at the club than a casual day spent relaxing.\",\"endings\":\"['Additionally, try to wear clothes that are designed for casual outdoor activities. For example, a dress without shirts can look ideal in an air conditioned parking lot, while a shirt without a jacket will look a bit inappropriate indoors.', 'Clothes which are highly structured, such as garments with stiff collars or strong shoulders, usually come across as dressy. [title] Slip on your favorite comfy jeans.', 'Go for a two-piece dress that hugs you in at least your waist, accentuates your sex appeal and offers some padding to your butt and hips. Solid black fabrics instead of dark denim are more appropriate for light, casual compression clothing.', \\\"Just make sure they are not tight enough that they slide up on your legs, or that they don't hang down too high on your belly button. Choose a bottom that you like and avoid material that will cinch at your waist.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}