{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fb064995-c6be-583f-9e7b-1af975f585c1","task_key":"default--validation--29547","task_revision_id":"1","upstream_id":"29547","short_description":"HellaSwag validation 29547","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do your makeup like kylie jenner [title] Prime your face. [step] A face primer will ensure your makeup goes on smooth and stays put all day. A primer can also help minimize pores, wrinkles, and blemishes, so it's an important first step to your skin routine.\",\"endings\":\"[\\\"[substeps] How you prime your face will depend on what you're wearing. Generally, exposure to sunlight will cause primer to stick to your face, so don't blow dry your face.\\\", \\\"Kylie's face looks flawless in every photo she takes, and primer will help you be ready for your close-up too. [substeps] Apply primer over your entire face using your fingertips.\\\", 'Brush or comb your teeth, so they are clean. [title] Use blush and eyes to set your face.', '[substeps] Apply foundation to your face a shade or two lighter than your normal (or \\\" natural \\\" skin color) skin tone. Blend well with a makeup sponge, or blend ahead of time.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}