{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"151c0680-8f72-5711-86ae-df02a7b51cd1","task_key":"default--validation--39321","task_revision_id":"1","upstream_id":"39321","short_description":"HellaSwag validation 39321","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your toddler to pedal a bike [title] Introduce your child to the bicycle. [step] While you do not need to go into detail explaining what each part of the bike does, it does help to give your child an idea of what she will be riding around on. Bring your child's bike out and set it up so that your child can look at it.\",\"endings\":\"['This will let her get a sense of the various construction features, such as wheels, hoses, etc. [substeps] After you teach your child to ride the bike, teach your child how to start pedaling on the bike.', 'Do not teach the whole bike or just the bike part, however. Instead, describe the bike so that your child will associate the three parts together in their mind.', 'As your child sees the bike, look out at the bike and give her the neck and handlebars circles. [substeps] Such circles can help them process what you are teaching them.', '[substeps] Point out where your child will sit, where the pedals are, and how the wheels move. Plan to begin teaching your child how to pedal when she is between three and six years old.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}