{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0bbf27ba-ff4e-5f72-bcfe-36e61008b7c6","task_key":"default--validation--31174","task_revision_id":"1","upstream_id":"31174","short_description":"HellaSwag validation 31174","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to build children's confidence [title] Help your child develop a positive self-image. [step] Help them to appreciate the good things about themselves. Being confident is about having self-esteem.\",\"endings\":\"['The more positive you are about yourself, the more people will think of you as more attractive. For example, show your child that you are smart, likable, and accepting.', \\\"By believing in them, they are more likely to believe in themselves. Confidence from adults boosts a child's self-image because they often look up to adults, who are their role models.\\\", 'Tell your child how special they are and let them know you appreciate the good things about them. [substeps] For example, if you are at work and an employee pays attention to your kids, let them know that.', \\\"Often, this means you can show your child something about yourself that anyone else would overlook. [title] Remind your child that being confident isn't all about looks.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}