{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc605502-6942-5be4-abef-672e0267e8e9","task_key":"default--validation--43632","task_revision_id":"1","upstream_id":"43632","short_description":"HellaSwag validation 43632","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have a smooth face [title] Wash your face twice daily. [step] Keeping your face clean is the best way to ensure that your face is free of pimples and other imperfections. Wash your face once in the morning and once at night as well as any time your face is sweaty.\",\"endings\":\"[\\\"[title] Exfoliate your face once a week. [step] Once you've exfoliated your face, use gentle scrubs and oily wet towels to do some quick exfoliation of your face.\\\", \\\"Your skin is most likely to become oily and greasy if it is washed once a day. [substeps] If your face gets oily, that's ok.\\\", '[substeps] For example, it is a good idea to wash your face before and after a workout or after you have been doing physical labor. Try keeping some cleansing wipes in your gym bag or purse that you can use to wipe off your makeup and cleanse your skin.', 'Gently squeeze your face to get out soap. Apply an exfoliating cleanser to your face and use a circular motion to gently exfoliate all over your face.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}