{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e8ca3275-a538-5e3d-aed9-ee216baef893","task_key":"default--validation--7691","task_revision_id":"1","upstream_id":"7691","short_description":"HellaSwag validation 7691","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to straighten men's hair [title] Wash and condition your hair. [step] Put the blow dryer on the medium heat setting and move it over your hair as you comb it. Use a nozzle attachment to help control the airflow.\",\"endings\":\"['[substeps] This method pulls out excess heat from your hair while warm. Do not underwash your hair when it is heated, and especially never use blow drying methods such as curling irons and straighteners.', 'Comb down from the roots to the tips. As the hair dries, it should be straighter than it normally is.', 'Focus on the roots and consider tying it into a high ponytail. Wrap a towel around your head and head over to the sink.', '[substeps] After finishing the blow dryer, give your hair a more thorough wash with a conditioner. This will keep your hair looking neat, hopefully without making it frizzy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}