{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1eec894a-2f61-519f-83c7-fbeed24727af","task_key":"default--validation--38507","task_revision_id":"1","upstream_id":"38507","short_description":"HellaSwag validation 38507","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be comfortable with your body [title] Practice positive self-talk. [step] It is easy to find things about your body to criticize, and every person, no matter how beautiful, has things about their body that they are less than thrilled with. Rather than focusing on the negative, challenge yourself to find positive things about your body.\",\"endings\":\"[\\\"[substeps] Come up with every single thing you like about yourself. Pay careful attention to the parts of your body that you don't like.\\\", \\\"[substeps] Maybe you have your father's chin, or strong arms, or great vision. Your best features may not be the ones that others would recognize, but they make you who you are.\\\", '[substeps] Say all these affirmations aloud as you walk, write them down in a book, or keep a journal. If a thought pops into your head about your body, ignore it and focus on how that thought makes you feel.', '[substeps] Note which parts of your body do not need to be judged, and which parts do. Although this is important, focus on what you can do well and be comfortable with.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}