{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9579bd63-f81d-5012-81b6-3462866a9ebe","task_key":"default--validation--1011","task_revision_id":"1","upstream_id":"1011","short_description":"HellaSwag validation 1011","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise a transgender child [title] Don't fight your child's gender. [step] Your child is already transgender, and you can't change that. Fighting your child's identity is exhausting, and it will cause them tremendous pain.\",\"endings\":\"[\\\"Resist the urge to argue with your child about her gender. Arguments are insignificant and can't hurt.\\\", '[title] Support your child through this difficult time. [step] Your child should not feel pressured into being transgender, but they should be as supportive as possible.', \\\"Instead, it's important to accept that your child is different, and let them live as they are most comfortable. [substeps] Trans youth who are accepted and able to live openly as their true gender are at much lower risk of mental health problems.\\\", \\\"Children who are transgender are often stubborn when it comes to love and acceptance. Arguing will only clog up your loved one's already blocked birth canal.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}