{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b1a8548-aabe-5790-87a5-5f6847b4b22e","task_key":"default--validation--20944--variant-b0312cf2c9b3","task_revision_id":"1","upstream_id":"20944--variant-b0312cf2c9b3","short_description":"HellaSwag validation 20944","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your child make friends [title] Model good behavior for your child. [step] Children look to their parents for guidance about how to behave in social situations. Modeling good social behavior when you interact with acquaintances, friends, family members, and other parents can help your children develop positive social skills.\",\"endings\":\"['[substeps] Look for similarities in your likes and dislikes. If you are just getting to know someone, pay attention to what the other person says he or she likes and point out similarities when appropriate.', \\\"[substeps] For example, if a friend invites the child to go to a friend's house, then it would be appropriate to go along with her, rather than being flashy and causing more drama. Avoid sacrificing your own attention for your child by modeling good behavior when you interact with other people.\\\", '[substeps] For example, if your child calls someone \\\" nice, \\\" you might only model this behavior as \\\" nice \\\". Acknowledge your child with non-verbal cues such as smiling, making eye contact, and following the person when the person is speaking.', 'You can mimic this by modeling good behavior when interacting with others. [substeps] For example, give your child treats when someone treats them in front of them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}