{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3171920-9ba8-5aa0-bddc-f448c34364e0","task_key":"default--validation--23667","task_revision_id":"1","upstream_id":"23667","short_description":"HellaSwag validation 23667","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress for church services [title] Think modest and conservative when picking out your outfit. [step] While church is a social gathering, it's not a party or a night out with your friends. Families of all different ages attend church and many churches are still conservative, so make sure to dress appropriately.\",\"endings\":\"[\\\"[title] Wear clothing that flatters your body. [step] Swimsuits or casual wear are good choices because they'll lift your spirits and get you more comfortable, but they may not fit your curves.\\\", \\\"[substeps] If you're a christian and your church doesn't have so much prepping going on outside, dressing conservatively probably will be appreciated by that church. But, don't forget to dress as much as possible when dressing for mass.\\\", \\\"You should eliminate backless or low-cut dresses, spaghetti straps, tank tops, or anything that shows your midriff. [substeps] Just because it has to be modest, does not mean it can't be fashionable.\\\", \\\"You may not be able to skip dressing for a religious service if you don't dress to a conservative level or your modest attire won't be noticed. [substeps] Men should dress out for funerals and organ fundraisers by wearing a suit with a black tie.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}