{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a3962621-759f-5e71-aed3-b14e5de2765e","task_key":"default--validation--34255","task_revision_id":"1","upstream_id":"34255","short_description":"HellaSwag validation 34255","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop aggressive toddler behavior [title] Remain calm. [step] If your child is acting out in an aggressive way, stay calm. Don't get angry, yell, or act in an aggressive way to the child.\",\"endings\":\"[\\\"They may get defensive and start a fight. If you can stay in a calm state, the child's aggression will escalate.\\\", 'Ask the child, \\\" what is causing you to behave aggressive? \\\" be patient and remain calm while the child speaks. [title] Play \\\" hide and seek \\\" games.', 'Instead, keep your cool and calmly tell the child that you understand it is not his fault. [substeps] Try to keep your cool even though your child acts out.', \\\"Remaining calm will help your child calm more quickly. If you get upset, that will feed your child's aggression and make things worse.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}