{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae4aef77-3689-504b-ac74-4909bda36653","task_key":"default--validation--3358","task_revision_id":"1","upstream_id":"3358","short_description":"HellaSwag validation 3358","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prepare for the arrival of a newborn as a father [title] Take parenting classes. [step] Parenting skills, like any other ability, can be learned. Taking parenting classes can help you learn what you'll need to know and do as you prepare for the arrival of a newborn.\",\"endings\":\"['Most classes cover changing diapers, bathing, burping, and feeding your baby, among other skills. [substeps] For a unique bonding experience, attend these classes with your partner.', 'Parenting classes can be offered for a lower income and also provide training with advanced skills. [substeps] Look for parenting classes at your local adoption agency (foster care facility) or talk to a family doctor.', \\\"Oftentimes, you'll find that you're good at parenting even when you aren't looking. [substeps] Various educational institutions and other institutions offer classes that educate you on parenting, including parenting and parenting skills.\\\", 'They can also give you perspective on the world, making this experience much better. [title] Learn more about parenting and parenting your baby.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}