{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5714ec5a-068d-5a1a-80ac-8b427666e0f7","task_key":"default--validation--43337","task_revision_id":"1","upstream_id":"43337","short_description":"HellaSwag validation 43337","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply self adjusting makeup [title] Apply a makeup primer. [step] Just like with a regular, color foundation, you want to begin your routine by applying a primer. A makeup primer creates a base for your foundation, helping it to adhere solidly and evenly and last all day.\",\"endings\":\"['[substeps] Visit a makeup store or pharmacy that sells small patches of primer that are good for your face and base makeup to go with a primer. Primer looks great on all skin types, including dark circles under your eyes, oily skin, and pale skin.', 'Although that base foundation should be somewhat opaque, it should not look greasy and stiff. [substeps] If you do not have a primer, you can choose a heavy, fluffy liquid foundation that is available at your supermarket, or also at arts and crafts stores.', 'It gives your self-adjusting foundation something to really \\\" stick \\\" to, smoothing out your skin so you can work on an even canvas. [title] Dot your self-adjusting foundation on your face.', \\\"[substeps] Any product you use day-to-day, from face paint to eyeshadow, will work just fine, at most. There are a lot of different primer formulas that you can buy to make your primer and foundation work, as long as it's in regular color form.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}