{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"386fedea-43a4-5b09-a7c8-030751e1e8c5","task_key":"default--validation--10174","task_revision_id":"1","upstream_id":"10174","short_description":"HellaSwag validation 10174","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to calm an upset or angry child [title] Ask them what's wrong. [step] This is an important step if it's not obvious why the child is upset. Even if you do know, it can be useful for them to articulate their experience in their own words.\",\"endings\":\"['[substeps] Encourage them to talk to someone if they want to. It may be helpful to have a sympathetic listener, so they can offer comfort to others.', 'This can help your child feel understood and in control. [substeps] Tell them why they are in the situation.', 'Expressing themselves can help them process their emotions and develop emotional awareness. [substeps] Naming and discussing their emotions will help them recognize them more clearly in the future.', 'Asking them directly how they feel will allow them to process their feelings. [substeps] For example, you might say \\\" i\\\\'m so sorry i snapped at you, but it\\\\'s really your fault! I am so frustrated right now that i can\\\\'t even focus on being present.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}