{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f9f2142-7ca1-5f6e-b513-b85f47508dd8","task_key":"default--validation--47929","task_revision_id":"1","upstream_id":"47929","short_description":"HellaSwag validation 47929","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help a blind or visually impaired child socialize [title] Establish the importance of social skills. [step] Building social skills in encourages positive healthy development. Bonding with siblings, parents, and family members provides a social safety net for the child.\",\"endings\":\"['Learning social skills while disabled is an intensive task. Reaching out to friends, family, and others will make the process of interaction simpler and more pleasant.', 'Connecting with peers increases self-esteem, self-worth, confidence and independence. [substeps] Our social skills are also known as soft skills.', '[title] Teach your child to respect socialization. [step] Make sure your child respects socialization by sending them texts asking for advice or a rides home after an activity that is often rewarding like going to the park or to a movie.', '[substeps] Children who are mentally or physically handicapped develop social skills. Experiencing social skills in children could encourage them to socialize as well.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}