{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f164b0ef-fffb-5cd9-9517-edc732510a68","task_key":"default--validation--16945","task_revision_id":"1","upstream_id":"16945","short_description":"HellaSwag validation 16945","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use makeup setting spray [title] Choose the right spray for your skin type. [step] Just like all facial products, different products work best on different skin types. If you have very dry skin, you may want to avoid products with alcohol in them, which can dry out your skin even more.\",\"endings\":\"['For fair skin, stay away from products with ingredients like : [substeps] Coconut oil aloe vera, grapefruit, or grapefruit oil cola and ice cream vitamin e [title] Practice your makeup. [step] Always practice your makeup step by step.', '[title] Mix up a base base to blend in your products. [step] A base base makes your skin feel shiny and smooth and helps to slim down the look of your face.', 'If you tend to use foundation, moisturizing is always a good idea. Otherwise, try applying a natural product like anti-aging cream.', 'Instead, find alcohol-free setting sprays that have moisturizing and hydrating properties. If you have naturally oily skin, look for an oil-free setting spray that provides a matte finish.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}