{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ea1675d-4259-5701-a064-4c89c652fcf0","task_key":"default--validation--11132","task_revision_id":"1","upstream_id":"11132","short_description":"HellaSwag validation 11132","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create beach waves [title] Avoid heat with fine hair. [step] If you have very fine or thin hair, avoid using heat treatments to create beach waves. Thin or fine hair may be sensitive to high heat.\",\"endings\":\"['Stick to things like braiding and twisting your hair without a flat iron or other source of heat. [title] Stick to elongating curly or frizzy hair.', '[substeps] If using a heat treatment, apply heat-protectant shampoo, conditioning serum, and shower gel to your hair and scalp as it heats. Use this on damp hair to soften hair.', 'Do not use ionizing products when bathing or getting dressed to create waves. [substeps] Avoid super hats, lotions, and hat holders.', 'Use a blow dryer to cool off hair that is not very fine, or do not use the setting for a curling iron. It may be safest to use a hair pick attachment to distribute the heat from a heated hair pick.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}