{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5140307e-f2d8-5e97-86b2-a805930274a4","task_key":"default--validation--19779","task_revision_id":"1","upstream_id":"19779","short_description":"HellaSwag validation 19779","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your autistic adult child find a job [title] Work with your child to develop his social skills. [step] One of the most important foundational things you can teach your autistic adult child is social skills. You can help them with this by letting them meet other autistic adults (find a local group of parents who also have autistic children).\",\"endings\":\"['Try to learn as much as you can about the social skills your child needs to find a job. [substeps] There are many different types of social skills.', 'Starting at a young age can be a great opportunity for a child to meet others with disabilities. [substeps] You can help your child develop social skills by joining local groups of children.', '[substeps] You can also help your son or daughter meet others like them online. This will help them hone their ability to make friends and get into the rhythm of building relationships.', 'They can gain experience in the social skills community. These adults can help you with yard work, reading, cooking, or even games.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}