{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74d06a9d-c31f-5ce0-9daf-961744e4a3a8","task_key":"default--validation--5085","task_revision_id":"1","upstream_id":"5085","short_description":"HellaSwag validation 5085","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help troubled teens [title] Talk openly with the teen. [step] While the teen may seem to ignore you, or be hesitant to share feelings, it's important to open the lines of communication. Discuss your concerns in a calm and loving way.\",\"endings\":\"['Be compassionate when listening to them respond or fail to respond. The teen may not be willing to open up every time.', \\\"Ask the teen if it's okay or if there is anything you can do to help. [substeps] After this, reassure the teen that adults need professional help when having difficulty.\\\", '[substeps] If you feel that the teen is not sharing their feelings with you, you may request that the teen open up and talk about how they feel. If they hold back, you may have to back off a bit.', 'At this stage, you should also let the teen know that an adult is the best way to help. [substeps] Although it is important to be compassionate with the teen and not belittle or upset them, it can be nerve-wracking for both of you to discuss your concerns.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}