{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"34cf61b9-84ec-5990-89c1-f0dbe5ce6d26","task_key":"default--validation--9233","task_revision_id":"1","upstream_id":"9233","short_description":"HellaSwag validation 9233","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to remove splinters in children [title] Know when using tweezers will be most effective. [step] This method works well if you can see the tip of the splinter or if a part of the splinter protrudes from the skin. [title] Explain the procedure to your child.\",\"endings\":\"['[step] Throw away the tweezers as soon as possible to prevent further splinters from falling in on your child as well. [substeps] The child might be embarrassed and upset, especially if your tweezers are meant to remove an actual splinter, or she might be scared that you might actually remove a splinter from her.', '[step] Explaining your specific instructions will give your child a chance to ask questions. Do not explain why you should use tweezers.', '[step] Some babies can be more sensitive to tweezers than others, particularly early in their lives. Also explain the process with your baby so they can accept that the splinters do not hurt them.', '[step] Instruct your child to stay calm and tell him that the process can be a little painful but will subside after the splinter is removed. If possible, have someone hold your child during the removal process, as children tend to squirm when they are in pain.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}