{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a4c672c-56cc-527a-b3c7-f8ae2f854154","task_key":"default--validation--3392","task_revision_id":"1","upstream_id":"3392","short_description":"HellaSwag validation 3392","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to keep your child healthy [title] Establish a sleeping schedule. [step] It is important for your child to get around 10 hours of sleep every night, depending on age. Going to sleep at the same time each evening will help this happen.\",\"endings\":\"['Sleeping at the same time on a regular schedule will ensure there are adequate hours of sleep to wind up each night. [title] Create child-centered mornings and nights.', 'It is also important to establish a schedule and stick with it even if it is a short one, like going to bed earlier, and then going to bed before you are expected to. Set the same times every night to establish a consistent bedtime.', '[substeps] Set a bedtime for each bedroom. Set your alarm to be consistent for on and off certain nights.', 'Stick carefully to this routine and only push back the bed time if it is absolutely necessary. When possible, allow you child to sleep in if they went to bed late.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}