{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87db750a-babe-554f-831f-53212994503e","task_key":"default--validation--44055","task_revision_id":"1","upstream_id":"44055","short_description":"HellaSwag validation 44055","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your child not to bully [title] Set a positive example. [step] Demonstrate kind behavior when you're with your own friends, loved ones, and your children themselves. Children mimic the language and behavior of parents.\",\"endings\":\"['If you want your child to be nice to other children, be nice to your child. [substeps] When your child is around, try your best to keep an even temper.', \\\"[substeps] Do your best to be kind, but also listen to your loved ones when they are talking with other kids. If you sit down with your kids and speak in their presence, you will look removed from the conversation because you aren't there to explain things.\\\", \\\"For example, demonstrating good posture and being composed and assured allows your children to rely on you. [substeps] Don't be mean and use angry or disrespectful behaviors.\\\", 'Make it your goal to teach your child that being kind and accepting of all forms of childhood behavior creates more healthy self-esteem. [substeps] Do not try to force your kid to \\\" be nice \\\" by using words such as \\\" he doesn\\\\'t want to be mean, \\\" or \\\" he wants to feel confident.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}