{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e880ec40-797a-54ae-8dbd-561b24e8997a","task_key":"default--validation--24081","task_revision_id":"1","upstream_id":"24081","short_description":"HellaSwag validation 24081","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your hair stay straight all day [title] Use shampoos and conditioners that help straighten hair. [step] Look for shampoos and conditioners that have lots of vitamins and minerals in them, giving your hair refreshing nutrients that will help smooth it out. These are usually marketed as smoothing, sleek, or straightening products.\",\"endings\":\"['[substeps] Look for a shampoo that lists \\\" hydrating ingredients \\\", which are sodium and other all natural ingredients. You can also try going for one that specifically states \\\" hydrating \\\" on the bottle.', '[substeps] If you have very curly hair, you may need to consider using a straightening shampoo. You can also purchase a hair-straightening powder and conditioners to help moisturize your hair.', 'If you have dry hair, look for shampoos that will keep it soft, wet, and shine. If you have hair that is frizzy, opt for sleek, volumizing, or foam shampoos.', '[substeps] Look for ingredients such as wheat proteins, pro vitamin b5, or hedera helix extract. Take the time to comb the conditioner into your hair while in the shower, using your fingers or a wide-toothed comb.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}