{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e355ecb2-887e-5591-a2d0-8b6125dc7c7d","task_key":"default--validation--26167","task_revision_id":"1","upstream_id":"26167","short_description":"HellaSwag validation 26167","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style air dried hair [title] Use a moisturizing shampoo and conditioner to prevent frizz. [step] Frizz is a very common problem with air-dried hair. Combat frizz by starting in the shower with moisturizing products that smooth the hair cuticle.\",\"endings\":\"['This will help reduce frizz and condition the hair. [substeps] When you use a moisturizing shampoo and conditioner, get into the habit of rubbing your hair with the moisturizing product more frequently.', \\\"[substeps] Hot water is helpful for combating frizz by setting the temperature to a cool setting, like room temperature. It's also good for drying out or straightening your hair.\\\", 'Opt for shampoos and conditioners that contain hydrating ingredients like shea butter, argan oil, soy proteins, and moroccan oil. Try to avoid shampoos and conditioners that list sulfates or alcohol as ingredients, since these can dry out hair.', 'You can find a wide variety of moisturizing products in your local supermarket and, if you are planning to keep your hair easily combed throughout the week, search for products with sunscreen. [title] Dry your hair with a clean towel.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}