{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9c32e053-c4f8-580a-80ff-9a11b6551a03","task_key":"default--validation--15409","task_revision_id":"1","upstream_id":"15409","short_description":"HellaSwag validation 15409","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make bath time fun for kids [title] Let them bring a doll into the tub. [step] Waterproof dolls are an easy way to give your child a new bath companion. They can even practice washing different parts of the doll to build good bathing habits! [title] Host races.\",\"endings\":\"['[step] Games such as fire-boats, sea-tragers, against the wind and dark bedtime go really well in this season. [title] Hang a television show on the wall so kids have entertainment during the day.', '[step] As kids get older, they may become interested in races that you see on tv and find themselves drawn to by the amount of excitement and laughter available. These races are often set up with dogs or cats to make sure the pets are happy all day.', '[step] Have the children choose their favorite toy boats or wind up toys. Place the toys at one end of the bath and count down.', '[step] If the children have a playing group, consider inviting them to a race to raise money for their favorite crafts. Race may take a while to feel cohesive, but it is very worth trying! [substeps] Competition often starts at half-time, like every day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}