{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab38cef8-9a28-5b46-bb8e-a08e7e303151","task_key":"default--validation--18336","task_revision_id":"1","upstream_id":"18336","short_description":"HellaSwag validation 18336","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise smart children [title] Encourage reading. [step] There are huge benefits to reading to your child every day. It helps develop their vocabulary and intelligence, as well as emotional bonds.\",\"endings\":\"[\\\"By not only encouraging reading, you encourage your child's knowledge and understanding, and they will also feel like they are getting enjoyment from learning. [substeps] Pick reading books that share information with your child.\\\", 'Reading to your child helps them understand what others think about their lives. [substeps] Make reading a regular part of their day.', \\\"[substeps] If you are a parent, read to your child at least once every morning and maybe even more frequently if it is a learning activity. Showing that your child understands new things's physical features, will make them stronger and easier to guide.\\\", \\\"When your child is old enough, let them pick out things to read for themselves. They'll love taking charge of what to read! [title] Talk about books.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}