{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"196da90f-f8e3-542d-bf0a-8fd49847b09f","task_key":"default--validation--18281","task_revision_id":"1","upstream_id":"18281","short_description":"HellaSwag validation 18281","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply a no 7 serum [title] Remove your makeup. [step] If you have any makeup on, make sure to remove all of it with a makeup removing wipe or by wetting a cotton pad with makeup remover. As an alternative, you can use a cleansing oil to take your makeup off.\",\"endings\":\"['Once your makeup is off, dump it in a bucket or wash it in a wash-rag. [title] Apply 2 tablespoons vitamin e oil or moroccan oil to your eyes.', '[substeps] If your skin is particularly dry, wait until makeup is off before applying a cleanser. Get a towel and wipe the cleanser from your face before applying a serum.', 'Consider allowing your makeup to dry for at least a few minutes, but do not keep it on longer. Removing makeup after cleansing will reduce the likelihood that it will stain your skin.', \\\"Regardless of the products you choose to use, use a little pressure as you wipe away your makeup and make sure to wipe your entire face. [substeps] Go back over areas of your face where you've applied more makeup, such as your eyes, to ensure that you remove it completely.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}