{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f5554ab5-8d71-5bbb-8744-95e13f6446e1","task_key":"default--validation--24496","task_revision_id":"1","upstream_id":"24496","short_description":"HellaSwag validation 24496","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your child to wash dishes [title] Build a safe work zone around the sink and/or dishwasher. [step] Start by providing a step stool or step ladder for your child, that way he or she can safely and securely reach the dishes in the sink. Also, all sharp and fragile objects should be removed to prevent any possible accidents.\",\"endings\":\"['[title] Give a set of instructions to your child. [step] Describe the instructions to your child so that he or she understands them.', 'Finally, you may also want to line the sink and floor with towels to collect any spills that may happen. These steps will help ensure that your child is safe while washing the dishes.', '[title] Purchase or lease a washing table in a safe location. [step] If you store dishes, the counters inside the washer and dryer are an easy place to grind your dishes.', 'Make sure all small objects, including plastic or porcelain bowls, are placed securely in the work area. [title] Make a hand-held washing table.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}