{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"246b13e6-2675-5bb9-a926-9a219782499b","task_key":"default--validation--30038","task_revision_id":"1","upstream_id":"30038","short_description":"HellaSwag validation 30038","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for bleached blonde hair [title] Shampoo less frequently. [step] Shampoos are designed to remove dirt and oil from the hair, but they can also strip your hair's natural cuticle. Bleach does the same thing, so shampooing every day just layers damage.\",\"endings\":\"[\\\"It's best to start at the roots and work your way up from there. Adding more products as necessary reduces the amount of time you spend washing and moisturizing your hair and damaging it with shampoo, until your hair is no longer bleached blonde.\\\", 'Long haired people with bleached hair may not enjoy having to wash and condition their hair once every two or three days. When possible, designate one day a week to shampoo your hair.', 'Think carefully about this before treating your hair with bleach, or you may end up causing more damage. [substeps] If you really want to keep your bleached hair as white as possible, shampoo more often.', '[substeps] Wash your hair every three to four days, especially in the first few weeks. Buy a gentle dry shampoo to spray on your roots to stretch the time you can go between washes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}