{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84abe38d-bfa7-5d01-9030-3796220fdee3","task_key":"default--validation--41518","task_revision_id":"1","upstream_id":"41518","short_description":"HellaSwag validation 41518","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to de poof hair [title] Avoid washing your hair every day. [step] Hair gets poofy and frizzy when it's dry. While washing your hair cleans it, it also strips your locks of the natural oils that keep it moisturized and more manageable.\",\"endings\":\"['What will help dry out your hair most is the natural oils. [substeps] Try to shampoo or condition your hair every day.', \\\"This is especially important when you shower, or when you're sweating. Avoid washing your hair with your showers, as this can cause or even split your hair pieces.\\\", 'If your hair is particularly oily, never wash it more than once a day. [substeps] If you normally wash your hair a lot, try making a point of making this a habit.', \\\"To keep your hair from getting poofy, wash it every other day at most. [substeps] If you already wash your hair every other day and it's still poofy, try two days between washes.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}