{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3d17575c-3a00-5c21-876a-90ce340a35cb","task_key":"default--validation--44932","task_revision_id":"1","upstream_id":"44932","short_description":"HellaSwag validation 44932","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to be a hipster (teen boys ) [title] Change your appearance slowly over time. [step] As you begin to dive into being a hipster, you can't suddenly change yourself overnight. It will be too expensive and you'll risk looking like a poser.\",\"endings\":\"['If you want to keep looking the same all the time, you have to make changes gradually and with confidence in your looks. Start losing weight or asking women to date you again.', 'Once you become a hipster, start expanding into fashion and use any downtime in your day to develop your outfits and make yourself style \\\" laid back. \\\" [substeps] For example, instead of changing your style at work, switch up your hair and makeup.', 'Make alterations to your closet one step at a time, and be patient with yourself as you learn how to be more of a genuine hipster. [substeps] Capturing the hipster look is difficult because the goal is to avoid mainstream fashions which are also not easy to define.', \\\"As you see gain in appearance, take your wardrobe and mannerisms to heart and make big changes so that the look you're creating will be what you want. [substeps] Think of some new clothes that you want to wear.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}