{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d69729f9-cef6-5ded-b430-de8bf944ac8c","task_key":"default--validation--4153","task_revision_id":"1","upstream_id":"4153","short_description":"HellaSwag validation 4153","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with a stepchild [title] Respect the child's level of comfort with you. [step] You want to make a positive impression on any stepchildren in your life, but be patient about doing so. The key to developing a positive relationship with your stepchild is allowing them to set the pace.\",\"endings\":\"[\\\"They will come to understand you if you encourage their comfort. [substeps] Don't demand that your stepchild make questions of you, which could signal to them that you don't think the child is a good fit for them.\\\", 'A compassionate sense of respect and understanding almost always goes hand in hand. [substeps] The child may be one of the first to come to you, and may feel awkward around you, for example, or feel their own kinship has been stolen.', \\\"[substeps] Know that younger children will come to desire a closer relationship with you, even if they seem to resist you at first. Focus on taking small, positive steps that let them know you're interested in them and in their lives.\\\", 'Each child is different, but you should give them the proper level of comfort with you in general. [substeps] While dealing with age-related issues can make parenting a little easier, you should give the child enough time and space to set the pace and let their own sense of style impact things accordingly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}