{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dcbbc511-d07d-53b2-953d-193de3dc6c36","task_key":"default--validation--29086--variant-32ed387058d4","task_revision_id":"1","upstream_id":"29086--variant-32ed387058d4","short_description":"HellaSwag validation 29086","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a hair mask for super silky hair [title] Collect your ingredients. [step] You'll need an avocado and olive oil to form the base of your mask. When it comes to adding moisture back to your hair, the avocado works great on all hair types.\",\"endings\":\"[\\\"You'll need a dollop of fruit juice or aloe vera gel to use and a wide variety of essential oils. [title] Make the avocado and olive oil.\\\", \\\"It's one of the best ingredients to use during this process. [title] Scoop a cup of avocado into a jar to use as the base.\\\", \\\"It's packed with vitamins-a, d, and e, to name a few-and contains fats and oils that nourish every strand of hair. [substeps] Olive oil is a powerful natural conditioner, and it will make your hair shiny and smooth.\\\", 'On fine hair, a particular mix of avocado and olive oil is necessary to create the mask. [substeps] Next, put avocado and olive oil in a small bowl.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}