{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95d0a687-76bb-5f4c-8000-aa2708f94212","task_key":"default--validation--1799","task_revision_id":"1","upstream_id":"1799","short_description":"HellaSwag validation 1799","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get wavy hair overnight (braid method ) [title] Wash your hair, but skip the conditioner if your hair is fine and straight. [step] You'll want to have clean hair for your braids, so shampoo as you normally would. However, conditioner can make the hair too silky if it is fine and straight, and silky hair has a hard time holding a curl.\",\"endings\":\"['For straight hair, run a comb through your hair, then rinse it out. [title] Sleep with the side of your head affected by the braid sticking out.', '[substeps] If your hair is very coarse and tangled and you absolutely must use some conditioner, use sparingly. It will make a big difference in how well your waves hold.', '[title] Wash with the coldest water setting. [step] The cooler the water setting, the better.', '[title] Stretch your hair, and rinse it with cool water. [step] Massage your scalp to distribute the moisture throughout.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}