{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a3c1cc4-f6a2-5ff8-8d71-25c21ef2d9bf","task_key":"default--validation--20589","task_revision_id":"1","upstream_id":"20589","short_description":"HellaSwag validation 20589","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply makeup on round eyes [title] Do your eyebrows. [step] Starting off, you should apply makeup to your eyebrows. When you have round eyes, adding a slight arch to your eyebrows can help make your eyes look bigger and more defined.\",\"endings\":\"['Use a lipstick or lip gloss to create a rosy glow. [substeps] In addition to applying eyeliner, you may want to apply thin, fluffy strokes of mascara, sweeping along the upper lashes to create a smokey look.', 'This may open up them and make them shine more. [substeps] If you already have round eyes, then you can create your own arch with your eyebrows.', \\\"That's usually done at night, when you're tired, like just before you go to sleep, so it doesn't take much time. Be sure to apply a generous amount at night.\\\", '[substeps] If necessary, gently pluck your eyebrows into an arched shape. Strive to straighten out your eyebrows when plucking them, and angle the ends of each brow to form a pointed shape.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}