{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81a43638-4b3b-5dd3-a0f0-e17ee0a8f904","task_key":"default--validation--28227","task_revision_id":"1","upstream_id":"28227","short_description":"HellaSwag validation 28227","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to ask for the haircut you want [title] Gather inspiration in images. [step] Look for or take pictures of similar hairstyles you like and are considering. You can find them on social media, in magazines, or by searching the internet.\",\"endings\":\"[\\\"If you can't find your favorite picture, get it printed and upsize it to the desired style. Keep the pictures of hairstyles you like in mind, and take the time to look at the fit and color of the hairstyle you want.\\\", 'It will help to use black and white photos as well, because it will help you create your own style. As you take pictures, make sure to check out different hairstyles and experiment to find the one that would feel most interesting to you.', 'Ask friends, family, coworkers, or even people you see in passing if you can photograph their hairstyles. This allows you to put together a portfolio of the styles you like or want as a reference point for your stylist.', \\\"If you have an idea you're interested in, let it guide you in developing your edgy hair hairstyle. [substeps] You can have images come out of the images you took into your head.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}