{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dcfb06c5-485d-5ee0-abe8-cae28f697c57","task_key":"default--validation--27449","task_revision_id":"1","upstream_id":"27449","short_description":"HellaSwag validation 27449","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to know if your toddler is eating enough [title] Notice how often they eat. [step] Most toddlers struggle with sitting at the table long enough to eat an entire meal. Pay attention to how often your toddler eats during the day.\",\"endings\":\"['Is it just an hour or a clock? Take these two things into account when developing a strategy for how frequently your toddler will eat. [substeps] Look at the time every hour (i.e.', 'If they eat five evenly spaced meals or snacks per day, they are likely eating enough. Toddlers are actually very good at determining when they are hungry or need to eat.', 'As a parent, you will be able to tell if they are eating enough because of how they act while eating. [substeps] Infants and babies that have huge stomachs tend to eat more quickly, but this does not mean they are full.', 'Some toddlers can sit for hours on end without eating, while others take an extra hour for lunch or dinner to rest and recuperate. [substeps] If you have your toddler eating continuously, start noticing that they start to step out of their seat quickly and forcefully.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}