{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97490f69-da34-59c7-8035-27347a3d6a7f","task_key":"default--validation--23163","task_revision_id":"1","upstream_id":"23163","short_description":"HellaSwag validation 23163","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to razor cut short hair [title] Start with short hair that is a few inches/centimeters long. [step] This method is great if you already have short hair but want to trim it shorter. It will also help add texture to your hair while reducing volume.\",\"endings\":\"['[title] Make sure that the lengths of your hair you are cutting are that length. [step] This will ensure that you have more curls and hair to soften the edges of your cuts.', 'It would be easiest if your hair is the same length all around. If your hair is very long, cut it with hair-cutting shears so that it is a few inches/centimeters long.', \\\"[substeps] Natural hair doesn't need to be short or long. It may be a few inches or centimeters longer if it is being trimmed by someone else and you don't know them that well.\\\", 'This method will reduce the overall amount of hair you have to keep if you plan to cut the entire length of your hair. [substeps] Long hair can be trimmed every 6 to 8 months, while short hair can be cut every 6 to 8 months.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}