{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e368d5f-08d6-5000-b49f-a4bf02e17fca","task_key":"default--validation--1622--variant-59d1542f608b","task_revision_id":"1","upstream_id":"1622--variant-59d1542f608b","short_description":"HellaSwag validation 1622","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy a wig [title] Decide if you prefer a synthetic wig or a human hair wig. [step] Most wigs are either made of out synthetic fibers, real human hair, or a combination of the two. [substeps] Synthetic wigs are especially great for holding volume with short hair styles.\",\"endings\":\"[\\\"Synthetic wigs can work better during the winter when it's cold, but you can always purchase them when you're warm. Wigs made out synthetic fibers are great for keeping shoulder length lengths or long bangs longer.\\\", 'They are often referred to as \\\" shake-n-go \\\" wigs because you can simply shake them out as you pick them up and then put them on. If you are experiencing hair loss due to chemotherapy treatment, most hair grows back within six months of your last treatment.', 'Synthetic wigs are typically made of the dried/rejuvenated space they cover human hair. Human hair wigs are a wig that is most often used on people with long/curly hair.', \\\"Synthetic wigs can be found at most wig stores. Wigs made of out synthetic fibers are easy to keep secure, especially when you're going to the wig store.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}