{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4621cc3b-cfe6-5434-9c0e-dca51c5b5912","task_key":"default--validation--42247","task_revision_id":"1","upstream_id":"42247","short_description":"HellaSwag validation 42247","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to contour and highlight on dark skin [title] Start with a base of your regular foundation. [step] You want to start by applying your regular foundation that matches your natural skin tone. Use this to smooth out uneven patches of skin and cover up things like blemishes and acne.\",\"endings\":\"['Make sure that your foundation is light-wash (silicone), contouring-free and has no foaming or harsh chemicals. [substeps] No-bb maybelline foundation, contains no foaming at all.', '[substeps] You can apply your foundation with a sponge or makeup brush. If you use a brush, apply the foundation in circular motions throughout your face.', '[substeps] You can use your normal foundation color, such as blue or pink. Or, you can use a bold color such as a hot pink or bright turquoise (purple can turn you in).', 'Then, apply a shade or two of blush and concealer to create the appearance of fair skin. [substeps] Use a concealer brush to get into the corners of your eyes and on the corners of your mouth.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}