{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e9a8cc2-7263-580e-8dac-a0961ead4e92","task_key":"default--validation--24325","task_revision_id":"1","upstream_id":"24325","short_description":"HellaSwag validation 24325","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to make two different size breasts appear the same [title] Pull your hair over the shoulder of the smaller breast. [step] If you have long hair, use it to your advantage by sweeping it over the shoulder of the smaller breast. Doing so will visually \\\" pad \\\" the smaller breast, balancing them out and making them appear to be the same size.\",\"endings\":\"['[title] Wear an asymmetrical top. [step] Asymmetry is a perfect tactic you can use to combat unevenness.', '[substeps] Pull the hair up and over the one smallest breast to cover the smaller one. If your struggling to get the hair covering that little breast covered, either use a fake hair scrunchie or duct tape to get rid of the extra excess hair.', \\\"[title] Clip the section of your hair that isn't showing as much into a ponytail. [step] You want your ponytail to go up most of the way to the crown of your head.\\\", '[substeps] Tuck the small breast under the large one. Pull it under one arm and vice versa.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}