{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc67ac87-3c6f-591a-95e6-005c8c65b49a","task_key":"default--validation--46078","task_revision_id":"1","upstream_id":"46078","short_description":"HellaSwag validation 46078","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your child the importance of gratitude [title] Start young. [step] Teach her the \\\" polite words \\\" as early as possible. When your child is a toddler, prompt her to say \\\" please \\\" whenever she asks for something and \\\" thank you \\\" whenever she's given something, no matter how small.\",\"endings\":\"['Teach her by saying the \\\" please \\\" repeatedly or just let her repeat it for you. For example, ask her to replace \\\" please \\\" with \\\" nice \\\" or \\\" thank you.', \\\"From a young age she'll understand that we must show respect and appreciation to those who do things for us. If she's too young to say the words, say them for her.\\\", 'In order to teach love, train your child to \\\" please. \\\" this will improve teaching and help start the process off with good manners.', \\\"When you're also teaching her to associate a single action with thanks, it can help strengthen her desire to practice gratitude. Your child should have a clear goal in mind when making attempts to start a gratitude journal.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}