{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf21fd46-dcf9-5bd9-9439-89ce2340a41f","task_key":"default--validation--13737","task_revision_id":"1","upstream_id":"13737","short_description":"HellaSwag validation 13737","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for a henna design [title] Don't touch the design directly after it's applied. [step] Henna paste is moist when applied. After application, you need to keep that body part away from any obstructions-clothing, hair, environmental factors-so that it doesn't smear the design.\",\"endings\":\"[\\\"[substeps] Avoid touching your henna design while it's still wet. You can also clean it before application to ensure that the inside is not likely to smudge.\\\", \\\"If your design has hair, gently brush the area with a spoon or a soft tissue after you've applied the paste. [substeps] When applying henna, be sure not to get it in your eyes or mouth, as you could possibly smudge it.\\\", \\\"( in the vet, though, it took ten to twenty seconds for the paste to dry up. ) this is particularly important if you're working outdoors or drawing on your tattoo.\\\", \\\"The paste usually dries within 5-10 minutes, but err on the side of caution. It will take approximately half an hour before the henna paste is dry enough that you don't have to worry about smudging it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}