{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67f3c5ab-4151-5e56-8570-04c9503b05e7","task_key":"default--validation--8673","task_revision_id":"1","upstream_id":"8673","short_description":"HellaSwag validation 8673","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply foundation and powder [title] Start with a clean face, then apply some toner and moisturizer. [step] Apply the toner first using a cotton ball, and the moisturizer using your fingers. The toner will help balance the ph of your skin.\",\"endings\":\"['Aim for an oil-free finish, since you want to make sure your foundation is not too light or too heavy. [substeps] Moisturizer will also keep your foundation from smudging and breaking.', 'It will also help tighten pores and make them less noticeable. The moisturizer will help keep your skin feeling smooth and soft.', \\\"[substeps] Blend a tiny bit for a matte finish, but don't fill in large pores. A bit of mascara will work best too, but if you're going for classy glam streaks, you might want to start with a dark brown or black.\\\", 'If you have dry skin, apply some foundation first. [title] Take a piece of white paper or a cotton cloth and fold it in half.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}