{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c865c2ef-28f2-5c33-bb60-6e3ff4077ea6","task_key":"default--validation--2087","task_revision_id":"1","upstream_id":"2087","short_description":"HellaSwag validation 2087","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to add rose gold to your eyes [title] Use concealer to form your base. [step] You want your eyeshadow to stand out, as rose gold eyes should really pop. Always start with a concealer to form a nice base on which you'll place your eyeshadow.\",\"endings\":\"[\\\"Use a liquid concealer to form a thin layer, so the eyeshadow won't move around too much. [substeps] If you added powder to your eyeshadow, you'll want to use heavier powder when making your base concealer.\\\", \\\"[substeps] Dab the concealer all over your eyelids and into your brow bone. Gently rub the concealer into your eyelids until it's blended into your natural skin tone.\\\", \\\"Make sure it's neutral or sheer. Then, blend in your setting powder by blending your mixture under your eyes until your eyeshadow sparkles.\\\", \\\"Concealer is made of the matte layer of the color. Take your makeup artist's instructions and choose your concealer to form your base.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}