{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afb20b4a-dff4-56c0-b358-cc93864071c3","task_key":"default--validation--43950--variant-491657d1a85b","task_revision_id":"1","upstream_id":"43950--variant-491657d1a85b","short_description":"HellaSwag validation 43950","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to understand violent behavior in children [title] Consider your child's age. [step] Younger children, generally between the ages of two and four, may have a hard time expressing their thoughts and feelings because their communications skills are not fully developed. This inability to communicate may lead to violent behavior as a means to express themselves.\",\"endings\":\"['[substeps] This aggressive behavior will most likely decrease as your child grows older and learns how to express himself without resorting to violence. [title] Be aware that boys tend to be more aggressive than girls, though girls are also very capable of violent behavior.', \\\"Additionally, older children, as well as children up to one year old, may also have difficult expressing their emotions. For example, young children may find it difficult to communicate by writing about how they feel or binge-watching movies they can't watch.\\\", \\\"[substeps] Older children, on the other hand, may still struggle with violent behaviors that they can't yet express. Their parents or those they hang out with may be frustrated with their child's childish thoughts.\\\", '[title] Ask what the child thinks about violence. [step] Children have a hard time understanding violence as an emotion, so they are more likely to interpret violence as another emotion.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}