{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"55d1857f-c4f8-50ab-9a49-73049842806f","task_key":"default--validation--35477","task_revision_id":"1","upstream_id":"35477","short_description":"HellaSwag validation 35477","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to discipline a child effectively without spanking [title] Let nature take its course. [step] Natural consequences are those that occur as a direct result of the child breaking a rule. You should talk to your child about these consequences and help them make the connection between the cause and effect.\",\"endings\":\"['With your help, they can process the incident and learn its lessons. In these cases, no parental intervention is required for a child to learn their lesson.', '[title] Be aware that behavior can lead to potentially dangerous consequences. [step] Not all children obey rules, and in so doing such a role can lead to psychological benefits for those around them.', \\\"[substeps] Psychologists believe that creating rules that are taught at their hands can help different discipline styles in treating a child. Children who use applied punishment may have less success than children who don't take their consequences seriously.\\\", 'Remember that most behaviour is cyclical and that the consequence is not sudden or complex. Your child should only be punished for breaking a rule if there is a serious source of frustration or worry that they can relate to and thus can explain later.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}