{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5348aa07-4c05-5427-965a-ef03551201e0","task_key":"default--validation--41124","task_revision_id":"1","upstream_id":"41124","short_description":"HellaSwag validation 41124","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to curl synthetic hair [title] Determine if you can curl the hair. [step] If you're using synthetic hair extensions or a wig, read the product label to see if it can be heated. The label should tell you how much heat the synthetic hair can handle.\",\"endings\":\"[\\\"If it can heat, then it's not dry. If it's not dry enough, it's not going to work, and you may have to wait a few minutes after the extensions have been heated to get the curl out.\\\", 'Some wig stores will prefer to only give hair extensions or wigs without any heat, meaning that you can curl your entire head of hair at once. But if your hair can withstand a much more extreme heat, try curling from your forehead down, to create waves.', 'Confirm that the products you use are not contaminants, and that you can use the products you intend to use for the look or style you are going for. Use the product once or twice a week.', \\\"If you're unsure if they can handle the heat or you want to curl your weave, test curl a tiny portion of your hair to see if it melts. [substeps] If testing to see if the synthetic hair will melt, ensure that you choose a hair that is slightly hidden so that if it does melt, it won't be noticeable.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}