{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0b99edf-d0aa-51ed-8b39-bc70f3814b03","task_key":"default--validation--7644","task_revision_id":"1","upstream_id":"7644","short_description":"HellaSwag validation 7644","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stop your foundation from getting cakey [title] Exfoliate your skin 3-4 times each week. [step] Always apply a moisturizer before applying any other makeup product. Moisturizing your skin before applying foundation helps prevent dryness.\",\"endings\":\"['It also prevents breakouts, which can occur if your foundation contains oil. [substeps] If you sweat a lot, you should exfoliate your face twice a week.', 'Avoid trying to exfoliate your skin more than once a week. [title] Use steam treatment in between washes.', '[substeps] Even oily skin needs to exfoliate. Your body is made up of many different layers, and studies show that some skin types take significantly longer to exfoliate than others.', \\\"If your skin is dried out, this may make any makeup look caked on. [substeps] If you don't have a facial moisturizer, you can buy one at most department stores or drug stores.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}