{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0572311-8735-5627-8d2e-8a5bbc3a7506","task_key":"default--validation--8043","task_revision_id":"1","upstream_id":"8043","short_description":"HellaSwag validation 8043","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to get over a girl that left you for another guy (teens ) [title] Take her off the pedestal. [step] Best girl in the world? Never met, and never will meet another like her? It's common to feel this way, but trust us, it probably is not true. So let your friends talk trash about her.\",\"endings\":\"[\\\"Ask your friends what went wrong, and vent the frustration. We love you for who you are, and there's no one better than you.\\\", \\\"There are a lot of teens who would at least look at where she is on a radar to make sure she hasn't left. Start with your friends, if you have the ball.\\\", \\\"Remind yourself of the annoying things she did. Do what you need to do to remind yourself that nobody's perfect, especially her.\\\", 'To get over her, you need to be prepared for the worst, because she is the one. Sometimes all you can do is make your own mistake.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}