{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae46f76b-ba41-504c-9a82-493b027bfdfe","task_key":"default--validation--44762","task_revision_id":"1","upstream_id":"44762","short_description":"HellaSwag validation 44762","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to love being naked [title] Identify reasons why you want to love being naked. [step] In order to motivate yourself to change the way that you feel when you are naked, identify some of the reasons why you want to feel good naked. Write these reasons down so that you can review them and decide if they are about you or about someone else.\",\"endings\":\"['If your reasons are about you, then you have a healthy motivation for improving your body image. If they are about someone else, then you may not have a healthy reason for changing your body image and you may need to see a therapist for help.', '[substeps] Ask yourself if you are feeling shame for having to wear underwear or wearing a towel. If you are passionate about wearing boxers, for example, you probably like your shape.', '[substeps] Once you have identified your reasons, take a break to rest and think about how to get out of the situation. Instead of comparing yourself to others, focus on how your body looks and how you feel.', '[substeps] For example, maybe you enjoy swimming because you like to spend time with your body. Or maybe you love exercising because you are proud of your body.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}