{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2059f830-512a-50d8-8996-1417cb9a3033","task_key":"default--validation--25824","task_revision_id":"1","upstream_id":"25824","short_description":"HellaSwag validation 25824","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get 80s curls [title] Start with clean, wet hair. [step] Wash your hair with shampoo and conditioner. Apply a heat protectant spray to damp hair to shield your locks from heat if you'll be styling with a blow dryer, curling wand or hot rollers.\",\"endings\":\"['[substeps] Freshly washed and dried hair is the main ingredient for lasting 80s-style curls. If your hair is very damaged, tangled or textured, you may want to detangle your hair in the shower using conditioner and your fingers or a wide-tooth comb.', \\\"If you are styling a hair or section of your hair with rollers, consider wet hair because it will have lighter roots which is attractive while still generating curls. [substeps] Remember, the hair you're styling should never be split into sections or set in a ponytail.\\\", \\\"[substeps] Use a towel to protect your hair from any heat from the heated rollers for the length of the hair you'll be curling. Avoid letting your hair down too often as this could cause breakage.\\\", 'Wait until your hair is completely dry and the curls are securely wrapped with a towel, before you twist your hair and situate your curl. Try : [substeps] Cool-hairbrush wet hair volumizing or temperature-safe hairspray bonus curls [title] Split your hair into parts.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}