{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"57fe5a38-d7c7-5849-ad26-342930a6b88e","task_key":"default--validation--25769","task_revision_id":"1","upstream_id":"25769","short_description":"HellaSwag validation 25769","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a cleansing balm [title] Determine your skin type. [step] Cleansing balms can work well for any skin type, but are especially helpful for people with sensitive or dry skin because they are less drying. When you choose your cleansing balm, you want to make sure that it's formulated for the type of skin you have.\",\"endings\":\"[\\\"It's always best to opt for a cleansing balm made from something you won't be using a lot of time or money on, since the drying process tends to be a lot more difficult for sensitive skin types. Select suitable cleansing balms for your needs.\\\", \\\"[substeps] If you've always had sensitive skin, rinse your face for five to 10 minutes in warm water. If you have different skin types, read reviews to figure out which one works for you.\\\", \\\"[substeps] If you have oily skin, using a cleansing balm with a soft cloth may help you prevent your skin from over-producing oils. If you have sensitive skin, go with a balm that doesn't have many ingredients.\\\", \\\"[substeps] You can find cleansing balm in many forms. Liquid and gel balms are good for oily people's skin; non-liquid balms are especially effective for those with oily skin.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}