{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1ec43015-6514-5387-adc5-da5e099bc630","task_key":"default--validation--46027","task_revision_id":"1","upstream_id":"46027","short_description":"HellaSwag validation 46027","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to start a hair care routine [title] Know your hair type. [step] Every person has different hair, and it often needs to be treated and taken care of in different ways. Learn what type of hair you have in order to take care of it in the best way possible.\",\"endings\":\"[\\\"[substeps] Hair types: curly and crunchy, long and curly-style, and fragile, naturally fragile--both whether they're dry or clean. Curly hair: hair that's clean and flyaway, rarely frizzy, seemingly tiny, and tends to curl and fall out almost immediately.\\\", '[substeps] Dense, curly hair needs to be conditioned like shampoo and conditioner. Fragile hair needs a roller cut or gel (for dry hair) and a chignon; dense, thick hair needs a chignon; extra thick hair needs a club.', '[substeps] Hair types are generally light and thick, with varying degrees of thickness. Darker hair generally has coarse ends, while lighter hair tends thicker.', 'Go a few days with natural hair, not using any products, and observe what your hair tendencies are. You may discover that your hair is : [substeps] Oily dry normal wavy straight curly thick fine once you have figured out your hair type, always treat your hair in accordance with that.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}