{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b5be933-9cc4-5ec5-a5dc-6b2cebda6e10","task_key":"default--validation--26202","task_revision_id":"1","upstream_id":"26202","short_description":"HellaSwag validation 26202","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with a defiant child [title] Set reasonable behavioral expectations. [step] You should set expectations for your child's behavior that are both consistent and clearly communicated. However, when you develop these expectations, consider your child's behavioral skills and abilities at their age.\",\"endings\":\"['[substeps] For example, your child might be surprisingly independent and smart. A child with unrealistic expectations for kids with low levels of social skills might not have the capacity to thrive very well because of their poor self-esteem.', 'This can help you better identify if your child is confident in driving the car and following reasonable expectations of drivers and adults on the road. [substeps] For example, if your child respects car safety and acts aggressively around street vendors, you should include expectations about how they can comply with the rules.', \\\"This can help you to avoid having to put your child in a class where they will have to step into their own shoes. [substeps] For example, set realistic expectations about your child's independence, ability to live by themselves, and ability to handle at least two children in a single year.\\\", \\\"For example, it may not be reasonable to ask your 8-year old to stay seated and quiet for several hours at a time. If you impose expectations for maturity that are beyond the child's capacity, you set your rules up for failure.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}