{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25ed8d74-6301-5f72-abd2-c7b37e385ce7","task_key":"default--validation--18717","task_revision_id":"1","upstream_id":"18717","short_description":"HellaSwag validation 18717","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to get rid of teenage acne [title] Keep hair clean. [step] This step is especially important for teens with long hair. Oily hair or hair products in constant contact with the face can help clog pores.\",\"endings\":\"['Plus, keeping your hair clean can lower your risk of this type of acne. Shampoo every other day to keep your hair healthy and moisturized.', \\\"If you have their face cleanser, shampoo, conditioner, and other moisture-collecting products, reduce contact time and don't wear them all the time. Your scalp needs to have some moisture on a regular basis.\\\", 'Even those with short hair can see blemishes around the hairline due to oily hair or hair products. Wash your hair regularly and try to keep your hair off of your face as much as possible.', 'If you have long hair, clean it well and let it grow out naturally. [substeps] Your hair often needs to be shampooed in the shower, especially if you smell, age, or have hair that gets dry and greasy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}