{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2eefa2e9-71b8-55b1-b59e-200eabab117f","task_key":"default--validation--35402","task_revision_id":"1","upstream_id":"35402","short_description":"HellaSwag validation 35402","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stay naturally beautiful [title] Cleanse and moisture your face daily. [step] Make sure you cleanse and moisture your face two times a day. Early in the morning and just before going to bed.\",\"endings\":\"[\\\"Keep it off your skin for a couple of days. Use a non scented face wash and moisturizing mud in between washes so it doesn't dry out on your face.\\\", 'Then before you go to bed, put a spritz your face with a little stream of water. [substeps] Next, put this on your face and make sure that it feels good.', 'This way your face is capable of sticking to this regimen long term. [substeps] Before attempting to expend time spent in the shower or getting ready in the evening hydrate yourself with some homemade red eye bags.', 'This will help keep your skin clean and looking fresh. Find a cleanser that suits your skin type.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}