{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"512c275a-4c56-5402-baf6-ea4f65022ec6","task_key":"default--validation--41779","task_revision_id":"1","upstream_id":"41779","short_description":"HellaSwag validation 41779","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to explain miscarriage to children [title] Plan what you want to say. [step] This will be a difficult, but important conversation. You may want to take some time to carefully consider what you want to say to your child.\",\"endings\":\"['You might be emotional when breaking the news, so it can be useful to have an idea of what you want to say. [substeps] Decide if you want to bring faith into the conversation.', 'If your child is a very young child, you may not need to talk about the miscarriage with them right away. [substeps] Avoid awkward questions like, \\\" what will you do with the baby if you survive? \\\" this can come off as accusatory and suspicious.', 'That way, you can clearly communicate what you want your child to know and get their full attention. [title] Ask how she wants to be treated.', \\\"You may want to include all aspects of your child's health, the onset of conception, and the pregnancy itself. [substeps] Decide what emotions are involved and what your child wants to hear.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}