{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"79465d8e-d21b-5885-84c8-ff09287ba6ee","task_key":"default--validation--19423","task_revision_id":"1","upstream_id":"19423","short_description":"HellaSwag validation 19423","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your toddler to sit still [title] Practice sitting still. [step] Sitting still does not come naturally to most toddlers, but you can practice the skill at home. To start, have your toddler sit in your lap for one full minute.\",\"endings\":\"['To move the child around, put on his/her diaper, while holding the infant on your hip. Put the diaper on one leg at a time.', 'Place your hand under his diaphragm, which is the area below the belly button. Put both knees up against your seat and place a small object between them both.', 'Tell your toddler to sit still, and say \\\" sit quietly \\\". Get your toddler on your lap as quickly as possible.', 'Challenge your child to sit as still as possible. Gradually lengthen the time until your child can sit still for longer stretches.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}