{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c63979b-5b3b-5bea-baf8-3bb696ee51ed","task_key":"default--validation--26280","task_revision_id":"1","upstream_id":"26280","short_description":"HellaSwag validation 26280","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear denim to work [title] Go for darker shades of denim. [step] In general, the darker the better for work appropriate denim. Go for darker shades, like blacks or dark blues, over light blue shades of denim.\",\"endings\":\"['The contrast makes it easier to use denim to go to work and also result in a slimmer job. [substeps] If you can see dark blue denim in a room filled with other shades of grey, you will look dressier.', '[substeps] Your work clothing palette will be packed with colors that will work well together. It can be helpful to buy denim that has metallic undertones.', \\\"However, be extra sure that there aren't any special colors or patterns in your darker jeans when you wear them to work. Wearing black denim shades can be alluring to work colleagues and clients.\\\", 'Darker colors can often pass for work pants or suits, keeping your look comfortable but professional. [title] Choose denim outfits that are otherwise work appropriate.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}