{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"833a1794-0650-5cc7-bf92-ad1719860f68","task_key":"default--validation--12400","task_revision_id":"1","upstream_id":"12400","short_description":"HellaSwag validation 12400","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to draw your own temporary tattoo [title] Gain inspiration from other people's tattoos. [step] Find tattoo designs on famous people that you like. If any of your friends have tattoos that you find aesthetically pleasing, do an image search online to find tattoos in a similar style.\",\"endings\":\"[\\\"If you don't like your tattoo, try different ones. [substeps] Conversely, when making your own tattoo, you might find that it helps increase your confidence.\\\", 'Get an understanding of tattoo culture so that you have a better grasp on what may look good on you. Visit tattoo blogs and follow tattoo enthusiasts on social media.', \\\"You can use the images to guide your own design, which is incredibly helpful for drawing on adults. [substeps] If your loved ones have tattoos that you don't like and/or have never been on/of before, search the surrounding images to find out more.\\\", \\\"Most tattoo artists have plenty of links to their drawings and backgrounds online, if you're in a group or if you know of others. [title] Choose a tattoo design based on the people you're involved with.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}