{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"429be068-2e84-5744-b8af-273f15eddd87","task_key":"default--validation--15339","task_revision_id":"1","upstream_id":"15339","short_description":"HellaSwag validation 15339","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply lip paint [title] Exfoliate and moisturize your lips. [step] Lip paint can dry out lips, so take some preventative measures before applying it. Use a lip scrub to gently exfoliate your lips.\",\"endings\":\"[\\\"You may use lip balms, like zasosazam or salicylic acid, to finish the job, if you don't have the time to do so yourself. Moisturize your lips with a toothbrush or a cotton ball.\\\", 'Use a lip brush that is designed for lip painting. [substeps] Instead of a mouth scrub, opt for an exfoliator that contains salicylic acid and sulfate, which can dry out your lips.', 'Begin at your top lip and work your way down to your lower lip. [substeps] Make sure your lips are moisturized using a lip scrub; otherwise, the paint could drip down onto your face and dry and make it more difficult to apply the paint.', 'Then, add a thin layer of lip moisturizer. Not only will this prevent drying, it will leave your lips looking smoother before you apply your lip paint.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}