{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da62bac3-6cd7-5afd-b3c5-0454e23ed687","task_key":"default--validation--16840","task_revision_id":"1","upstream_id":"16840","short_description":"HellaSwag validation 16840","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to manage thick hair [title] Wash your hair at least twice a week. [step] If your hair is especially unmanageable, wash it every other day. When left unwashed, thick hair can build up grease and grime, and it can tangle wildly out of control.\",\"endings\":\"[\\\"Use shampoo and conditioner, but not every day. Shampoo helps keep your hair from getting too greasy, and conditioner helps tame it so that it doesn't grow too wild.\\\", 'Washing it less often is also a surefire way to curtail tangles and keep your hair from getting greasy. [substeps] When you wash your hair every other day, conditioner is running hard on your hair, and the ends may become greasy.', 'A flat-head brush and 2-3 in (5.1-7.5 cm) wide-toothed combs can help keep your hair clean and manageable. It also removes tangles from your hair and allows you to do whatever you want with it.', 'Never use a comb, brush, or shampoo, as they can damage your locks. [title] Remove all tangles with a good shampoo.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}