{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"462ec346-2a34-5824-ab31-3c1d3ca2d641","task_key":"default--validation--31850","task_revision_id":"1","upstream_id":"31850","short_description":"HellaSwag validation 31850","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have smooth and silky hair [title] Wash your hair a few times a week instead of every day. [step] In order for your hair to stay soft and smooth, it needs the natural conditioning of sebum, the oil that your scalp produces to keep your hair strong. If you wash your hair every day, you rinse away this nourishing oil, leaving your strands feeling dry and coarse instead of smooth and silky.\",\"endings\":\"['[substeps] When you shampoo and condition your hair, work it through in small, multi-strand sections with your fingers. Use a texturizing spray each time.', '[substeps] Instead of shampoo, use conditioner. You can also use a loofah for this purpose.', \\\"If you skip washing your hair, you won't be able to maintain that smooth and silky hair. [title] Follow what proper shampoo and conditioner you apply to your hair.\\\", \\\"[substeps] Find the washing routine that's right for you. Some people do it 2 or 3 times a week, while others wash every other day if their hair is especially oily.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}