{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae7f01d8-b5ee-50d0-8dd8-dabf04716de8","task_key":"default--validation--3888","task_revision_id":"1","upstream_id":"3888","short_description":"HellaSwag validation 3888","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be friends with your kid [title] Build one-on-one time into your daily routine. [step] Spending time together doesn't always \\\" just happen; \\\" it takes effort to make it a daily activity. During this time, you can give your child your full attention, allowing them to open up to you.\",\"endings\":\"['When you give your child details about the good things that happen in their lives, they will be more relaxed. [substeps] Figure out what kinds of activities your kids enjoy.', \\\"You can compliment your child about something and offer an explanation. This build up may seem like you would ordinarily share with them, but it's good to foster a trusting relationship.\\\", 'Here are some times you can spend together : [substeps] Driving to and from school/activities dinnertime 10-minute chat after school bedtime routine [title] Learn how to listen to your child. [step] Active, nonjudgmental listening will help your child feel that they can tell you anything.', \\\"[substeps] Spend quality quality alone time with your child. Don't be afraid to ask for advice or want to talk things over.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}