{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae0c7689-17b7-5dc5-a381-8a008fe6084c","task_key":"default--validation--34223","task_revision_id":"1","upstream_id":"34223","short_description":"HellaSwag validation 34223","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get a toddler involved in sports [title] Ask them what they are interested in. [step] Toddlers may be young, but they do have a good idea of what types of things they are interested in. Ask your toddler if they would like to try a sport, and consider their answers seriously.\",\"endings\":\"[\\\"[substeps] Let them know that it's a fun activity to do, and perhaps a game they enjoy. If they play a special sport such as soccer, you can start your intervention by asking what they might enjoy: riding a bike or playing with dogs.\\\", \\\"[substeps] If a toddler says no, it might be because they don't want to try a sport yet. In this case, let them practice on their own or get them to an adult who can help them take care of the toddler.\\\", '[substeps] You can say, \\\" if you could play any sport, what would you choose? \\\" you can also give the toddler options. For example, you might say, \\\" do you want to take karate or would you rather learn soccer? \\\" get your toddler interested by sharing your own interests with them.', 'Most children are excited about basketball, lacrosse, soccer, and football. [substeps] Use a prompt like \\\" did you know that some schools just accept senior players? Can you think of anything? \\\" [title] Look for a way of dealing with alcohol related challenges in your toddler.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}