{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"13cb5c8b-37c6-57eb-8942-e6d8f63b4f8f","task_key":"default--validation--44688","task_revision_id":"1","upstream_id":"44688","short_description":"HellaSwag validation 44688","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear leggings in summer [title] Choose a breathable material like cotton to avoid overheating. [step] You want something with good ventilation for hotter days, and your best options will be a cotton or lycra blend, or even bamboo. [substeps] Some legging styles also have mesh stripes or bands, which can increase breathability as well.\",\"endings\":\"['These have a sporty look that will go well with oversized t-shirts and jerseys. [title] Try leggings on before buying them to make sure they look and feel good.', 'Look for leggings that are without padding or at least cling to your legs. These are thin cotton pieces with small straps and attached sleeves, around the top of your legs and neck.', '[title] Choose solid neutrals to avoid color schemes. [step] Since these garments are designed and created to create patterns on the basis of contrasting colors, you want to avoid anything off of these colors.', \\\"It's easiest to make sure that your fabric is breathable when wearing leggings in the summer, though, particularly in colder months. If you're just getting started, you probably won't need to invest in underwear.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}