{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2821ef30-daac-57a9-a058-d5adbe0d14c6","task_key":"default--validation--8130","task_revision_id":"1","upstream_id":"8130","short_description":"HellaSwag validation 8130","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop your stress from harming your child [title] Watch what you say around your child. [step] Children are constantly learning from their parents. Thus, you need to be very cognizant of everything you say when you're around your child.\",\"endings\":\"['Therefore, as a parent, it\\\\'s important to practice mindful listening as a form of \\\" wisdom. \\\" try listening closely to your child instead of laughing, crossing your arms, or doing anything to just let your child know you are listening.', \\\"Learning doesn't just mean tuning your child into what you say. It means hearing your words aloud several times throughout the day.\\\", \\\"You'll want to be as restating what you say as you make a conscious effort to keep your words humble and brief. [substeps] Practicing tone-lowering means minimizing drama that can easily shock a child.\\\", 'Pay attention to the volume of your voice and your tone as well. Even if your child is too young to understand what you mean, they can still understand when you are angry by the volume and tone of your voice.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}