{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0c8cfbf-ef07-5c8f-adfe-ec6358930607","task_key":"default--validation--2362","task_revision_id":"1","upstream_id":"2362","short_description":"HellaSwag validation 2362","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to retwist dreads [title] Pin away unnecessary hair. [step] If you have to retwist an entire head's worth of dreads, you should start at the nape of the neck. Pin away the upper dreads with clips to leave an inch (2.54 cm) thick row of dreads across the base of the neck.\",\"endings\":\"['[title] Wrap a trimmer around a hand-held hair clip to keep dreadlocks off. [step] Use a trimmer, a brush, or your fingertips to create a groove between the top of the trimmer and the clip holding dreads in place.', 'When a section is completed, pull it away, use bobby pins or clear clips to secure the section and prevent sticking, or just secure it with hairspray. Leave the bottom dreads out; avoid blocking or rubbing them with hairspray.', '[substeps] If the nape of your head is shaved, be sure to trim the bald part right above the set of dreads. This is most likely to happen when a stylist is taking hair off.', '[substeps] If you are only retwisting to firm up the locks of a certain section of hair, you may not need to pin hair out of the way. [title] Gather hair at the base of the lock.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}