{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69cc74ef-4471-5dcb-9e40-73ef024a7432","task_key":"default--validation--23930","task_revision_id":"1","upstream_id":"23930","short_description":"HellaSwag validation 23930","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have great skin [title] Wash your face twice a day. [step] Don't over-wash your face, however. You will dry out your skin, which will cause it to produce extra oils to compensate.\",\"endings\":\"['Getting rid of oily skin on your face might also help you to eat healthier. [substeps] You can use a cleanser containing salicylic acid, such as lady gotham a, or you can buy cleansers with amino acids and vitamin c.', 'Instead, wash your face in the morning when you wake up, and in the evening before you go to bed. Use a gentle face wash designed for your skin type.', '[substeps] If your skin is greasy or needs to be oily, you can mix 1 to 3 drops of oil into a brush or your fingertips. Apply this oil to your face in an upward direction (above and below your nose) using your fingertips.', 'Body wash will help hydrate your face, but will also help it to stay moisturized. Apply sunscreen when you go outside, and use an spf 30 sunscreen once a day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}