{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e9bc2a61-2364-5978-9d46-4416e3f0c477","task_key":"default--validation--16631","task_revision_id":"1","upstream_id":"16631","short_description":"HellaSwag validation 16631","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply bronzing lotion [title] Choose a bronzing lotion. [step] There are many different bronzing lotions to choose from. Choosing a bronzing lotion based on your skin type, color, and you desired tan will help you achieve the results you are looking for.\",\"endings\":\"['There are three types of bronzing lotions : [substeps] Moisturizing creams. Moisturizing lotions are products that lock on your bronzing and provide additional moisture while enhancing your tan.', 'Some bronzing lotions allow you get instant results while others take up to a week. Some are longer lasting while other are more temporary.', 'Benchmark is one of the most popular products available, but there are also several different brands that are available and offer a variety of different shades of bronzing lotion. [substeps] You can also try different types of products to determine which bronzing lotion will work best for you.', 'Choose between tinted or untinted if you want even more sun exposure. [substeps] Tinted or untinted bronzing lotions are for both male and female users.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}