{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5596fb11-367f-5d1a-948e-2c9670dbef41","task_key":"default--validation--4805","task_revision_id":"1","upstream_id":"4805","short_description":"HellaSwag validation 4805","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach a child to sew [title] Know what age kids can start to sew. [step] Age, in general, doesn't matter. What matters is motivation.\",\"endings\":\"['[substeps] Children can start to work with children around the age of one or two, as well as with their immediate family members. If they know how to sew, they are more inclined to learn.', 'Kids learn with age-take a look. For instance, if you are teaching kids how to sew, you can instruct them on why they can wear a hat.', \\\"Not all children are able to sew faster than a lot of their peers. If your child isn't ready for the project you will have to provide him with a use for his hands, it'll be tough for him to be able to keep up.\\\", \\\"If you're child shows an interest in learning how to sew, this is the indicator that they might be ready to start learning. [substeps] Some sewing instructors, however, recommend waiting till your child is around 6 years of age before introducing them to a sewing machine.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}