{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87ae45d2-e1ef-5022-a74a-b5ca45c55e5b","task_key":"default--validation--25456","task_revision_id":"1","upstream_id":"25456","short_description":"HellaSwag validation 25456","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to avoid eyebrow piercing scars [title] Choose a quality piercer. [step] The person doing your eyebrow piercing should be a trained professional. They should work in a sterile environment with sterile tools, know the proper piercing technique, be knowledgeable about the piercing industry and experienced in piercing eyebrows.\",\"endings\":\"['[title] Decide how often you want to see your piercer. [step] Each piercer will have its own schedule, so it should be understandable if you need to see a surgeon once a month.', 'You should feel comfortable with them and able to ask them any questions you have about the piercing. [substeps] Check to see if the piercer is certified by the state and if the piercing facility is licensed by the state.', \\\"If you're confused about what piercers specialize in, keep looking. If you're on a budget, look for a piercer who is experienced.\\\", 'They should be experienced when piercing blood vessels, especially in specific parts of the body and should be able to take regular images of them. [title] Ask your piercer to do an imaging test.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}