{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"96b00e8a-0a52-5e0c-a6fd-7dd9b0f3dd3f","task_key":"default--validation--35413","task_revision_id":"1","upstream_id":"35413","short_description":"HellaSwag validation 35413","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take care of pale skin [title] Wash your face daily with a mild cleanser. [step] If you have extra sensitive skin, or any time your skin becomes irritated, wash it only once a day with a basic cleanser. Use gentle makeup remover wipes or micellar water to wipe off makeup and dirt for your second cleansing routine.\",\"endings\":\"['Apply a light moisturizer over your face, then wipe off any excess makeup with a clean towel. [title] Peel or exfoliate your skin.', \\\"[substeps] Even if you don't want to put makeup on yourself, too much makeup can also add flakiness and dryness to your flawless skin. [substeps] A good rule of thumb is not to put one on too early on.\\\", 'Let the facial scrub sit on your face for thirty minutes before rinsing it off with lukewarm water. If you have dry skin, a facial wash can help restore moisture.', '[substeps] Use cleanser in the morning or night, whichever works best for your schedule and skin. Micellar water, used by french women for years, is enriched with micelles, molecules that literally eat up dirt and oil, and is extremely gentle.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}