{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc0d3ea8-abec-5af3-9f33-e0355d1210cc","task_key":"default--validation--30550","task_revision_id":"1","upstream_id":"30550","short_description":"HellaSwag validation 30550","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle a preteen's tantrums [title] Stay calm. [step] While it's very hard to be nice and calm when someone is throwing a fit, yelling or screaming, it's important to not overreact. Avoid yelling back at your child.\",\"endings\":\"[\\\"Yelling along will only add to your child's anger. [substeps] Try to remain calm when the child throws a tantrum.\\\", 'Yelling will only escalate the situation and you may even shift the situation onto you. [substeps] Like most children, preteens are short-tempered and can feel unsafe when angry.', 'Yelling or hitting them can affect their temper. Instead, use several deep breaths and take positive actions.', 'They are upset and will likely be more upset if you make them feel unprotected or unloved. Try to soothe their frustrations by first focusing on how to soothe yourself in this moment.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}