{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"742b25ca-4f2b-571d-a892-ea5f16cd8fcf","task_key":"default--validation--42005","task_revision_id":"1","upstream_id":"42005","short_description":"HellaSwag validation 42005","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to put a two year old to sleep [title] Determine a good time schedule. [step] Allow plenty of hours between nap time and bedtime. If they are too close together, your child is unlikely to sleep.\",\"endings\":\"['[title] On average, a two-year-old sleeps about 11 hours at night and two hours during the day, although this is not a solid rule. [title] Be sure your child has enough physical exercise.', 'This will not prevent them from falling asleep and waking up at the same time each night. Stick to a schedule that gives you the optimal amount of time for bed time.', 'If they are too far apart, your child may be more prone to wanting to sleep. Always factor an hour before bedtime into their age-appropriate sleep/wake time.', 'Make sure that the nap time and bedtime are within this timeframe. [title] Make the naps shorter than regular ones.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}