{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4bf02ec-9e39-5550-aa4f-acc7abdf7fea","task_key":"default--validation--2294","task_revision_id":"1","upstream_id":"2294","short_description":"HellaSwag validation 2294","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help children mature socially [title] Watch for opportunities to teach empathy. [step] Empathy is one of the most important skills for a child to build. Empathy marks social maturity as it requires putting oneself in another person's shoes, which is often a difficult thing for a young child to do.\",\"endings\":\"['Therefore, it is important to watch for opportunities for children to teach empathy, whether that be in school or in a group setting. [substeps] Learn how to train a child to train.', \\\"Throughout your day-to-day life, look for opportunities to teach your child about empathy. [substeps] Encourage your child to consider things from another person's perspective.\\\", 'However, empathy also locates the path you are on so that the child can understand why you feel that way. [substeps] Telling a young child to turn to empathy instead of judging her when she is struggling could teach her to empathize with others and her character.', 'The very first step towards building compassion is to assess what social interactions are unavoidable. [substeps] Social interaction occurs when children bond with others over shared interests or needs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}