{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"653353bd-280c-5ce7-b14e-26c3cb0cafe0","task_key":"default--validation--34699","task_revision_id":"1","upstream_id":"34699","short_description":"HellaSwag validation 34699","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do glitter eyebrows [title] Brush out your eyebrows to start. [step] Use an eyebrow brush here. Gently run it through your eyebrow, using light stroking motions, to brush each eyebrow smooth.\",\"endings\":\"[\\\"[substeps] If you want to make the brush too rough, don't worry! It shouldn't be so rough that you mess up. Brush each eyebrow first, in the direction of the arch.\\\", '[substeps] If you already have a thin coat of brow gel, you can simply hold the brush at the base of one eyebrow and gently run it down your eyebrow at the end, creating a circle in your brows. [title] Use temporary and permanent mascara to close your brows.', \\\"It's important to start with a nice smooth brow before applying glitter. [title] Dab a small section of glue on the corner of each eyebrow.\\\", \\\"You can sweep the brush across both brows, holding it there as you move and not pressing it up and down, or you can let the brush end up on the brow. Don't wipe away the brush; simply graze the bristles along the brow bone.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}