{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36fa6a6d-ec1d-5e58-9563-7ab3a67709e6","task_key":"default--validation--16613","task_revision_id":"1","upstream_id":"16613","short_description":"HellaSwag validation 16613","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a glycolic acid peel [title] Schedule some downtime. [step] This is especially important if you've never done a peel before. Your skin might be red and sensitive after the peel, so plan to do it when you have a few days when you don't have to go to work or any social functions.\",\"endings\":\"[\\\"[substeps] Don't wait until you've had a really long rinse at the end of your peel. You'll need to be fairly active beforehand and will need to rest your skin for an extended period of time each day.\\\", \\\"There's no need to break yourself off from work or social events. It can be relaxing just to make an event out of it.\\\", 'During these days, simply stop out and have a liquid peel. [substeps] If you do not have time to see the doctor or to complete the peel at home, schedule a time to simply stop into the makeup equipment store.', '[substeps] For example, you could plan on applying the peel to your skin on a friday afternoon after you get home from work. This gives your skin the rest of the night friday and all day saturday and sunday to heal.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}