{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e2279ac-e954-5f1a-9d97-388ba5a56986","task_key":"default--validation--44082","task_revision_id":"1","upstream_id":"44082","short_description":"HellaSwag validation 44082","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear mascara for sensitive eyes [title] Wear a mascara for sensitive eyes. [step] A good way to be able to wear mascara is to find the type of mascara that is good for sensitive eyes. This may be labeled as sensitive mascara.\",\"endings\":\"['[substeps] If you have sensitive eyes, this form is a good choice. If you have sensitive eyes, use this form of mascara to smooth out any breakage and help make your lashes appear more natural.', 'You will need to know the guidelines in order to determine what type of mascara is best for you. [title] Consider using a liquid or gel mascara.', \\\"[substeps] A good rule of thumb to follow is to find a mascara that is strong, waterproof, and made up of natural ingredients like protein and zinc. Brands like aveda and dove are also good, but these can't help you look beautiful or sexy.\\\", 'Other types of mascara to try include hypoallergenic, organic, or natural. [substeps] Try brands like clinique, bobbi brown, almay, bareminerals, or physicians formula.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}