{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"39e99625-ac33-54e5-8cd6-75eab1f4d9d7","task_key":"default--validation--23560","task_revision_id":"1","upstream_id":"23560","short_description":"HellaSwag validation 23560","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply makeup to look more masculine [title] Apply a layer of beauty balm. [step] This will smooth out your skin and conceal some blemishes and discolorations. You should use balm over foundation.\",\"endings\":\"[\\\"Foundation will make it obvious you're wearing makeup. Balm will smooth out your features, prepping your face for makeup, without making the fact you're wearing makeup obvious.\\\", 'A dewy finish helps keep oils in your complexion alive and prevent breakouts. [title] Apply a champagne foundation with a blush on one side.', 'Apply more than a pea-sized amount so the balm gets onto the wrinkles (see section 8 below). [substeps] Repeat with water to hydrate your face.', 'Use 3-5 drops per eyelid to ensure minimal coverage. Cover your waterline, both inside and outside your eye; dot a small amount over the waterline at the center of the lens.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}