{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"552a536b-e37f-5a49-bcb7-62cc4e3f73fc","task_key":"default--validation--48144","task_revision_id":"1","upstream_id":"48144","short_description":"HellaSwag validation 48144","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have the healthiest, clearest skin [title] First figure out your skin type. [step] Oily? Dry? Sensitive? Combination? Knowing this can help you target those areas and improving them. [title] Depending on your skin type your going to need to find some products that suit your face.\",\"endings\":\"[\\\"[step] You'll need a cleanser, mask, toner, moisturizer, and a formula that you can dab on blemishes and will tone down redness and make it disappear faster. [title] You should wash your face in the morning and at night.\\\", '[step] This is hard to find all that you can buy, or everything you might need. Get a store wig, and two picks, a bucket and/or glove, a towel, a sponge and a brush/comb, and any body essentials.', '[step] Have another person choose the product you want to use and personally try it on your face, then judge by their reaction. Ask them if they would try it on you.', '[step] If you have dry or combination skin (purple, peach, redhead) oily? These products work equally well. Not all products you can use do different things.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}