{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7fe5dc08-eaef-5831-b2b5-21bce0340597","task_key":"default--validation--41458","task_revision_id":"1","upstream_id":"41458","short_description":"HellaSwag validation 41458","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wash short hair [title] Pay attention to your scalp. [step] Identify the kind of scalp you have. The type of scalp you possess affects the types of shampoo and conditioner products you should be purchasing for healthy short hair.\",\"endings\":\"['Look closely at the bottle before you buy. Whether the product is hydrating, clarifying, or moisturizing, its main properties should be listed right on the bottle for you.', '[substeps] Note whether your hair tends to be oily or dry. Oily hair is a much higher risk for hair cancer than dry hair.', \\\"As part of your hair care regimen, you'll need to care for your scalp. There are many different types of hair, and choosing a hairstyle and style that reflects the kinds of hair you have will give you total control over your hair quality.\\\", 'Depending on your hair type, you may have none/none of the following symptoms, so pay attention. [substeps] Oily hair forms oily or puffiness when it is blended with other healthy hair products.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}