{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e7820d3-0219-57c5-abee-54902408b993","task_key":"default--validation--2370","task_revision_id":"1","upstream_id":"2370","short_description":"HellaSwag validation 2370","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with boys [title] Understand that young boys are always on the go. [step] By the time they're toddlers, boys begin developing gross motor skills at a faster rate than girls of the same age. This means that most young boys are always moving, bouncing, running, kicking, and seemingly trying to hurt themselves in increasingly inventive ways.\",\"endings\":\"['[title] When puberty advances, consider these behaviors in the moment. [step] Now, it will be decades before they are in shape, so consider their intentions before you can decide if your mothering is appropriate.', 'Channel that energy into activities such as sports, play time, and even household chores. [substeps] Ensuring your boy gets plenty of opportunities for exercise, especially outdoor exercise, will help tire him out.', 'Older boys are undeveloped and develop unknown control over all of their bodily functions. Yet here are some things that older boys are capable of trying out : [substeps] Making hands over funny things.', 'Growing up in a household with a demanding life, are often at some point bound to make young boys more aggressive towards other children. [substeps] If you see a child constantly getting aggressive with other children, it can lead to violent outbursts.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}