{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ada4127-b01e-5ccb-acf0-649256c4e83f","task_key":"default--validation--17007","task_revision_id":"1","upstream_id":"17007","short_description":"HellaSwag validation 17007","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have nice and clean hair [title] Select the best shampoo for your hair type. [step] With so many brands and choices, it is easy to be overwhelmed with selecting a shampoo. When it comes to selecting the best shampoo, decide what your hair needs most.\",\"endings\":\"['Remember that changing your hair type can result in different growth patterns, as well as increased risk for hair loss. [substeps] If you have thick hair, choose a shampoo that is specifically for curly hair.', 'If your hair is usually straight, you may need a sulfate-free shampoo. If it is generally wavy, you may want to vary this amount to balance out the curls.', \\\"If you have straight or curly hair, you will need to follow the following tips : [substeps] Don't use a shampoo that is too harsh and packed with chemicals or sulfates. Avoid using a salon-specific shampoo because these will create tight, wavy hair.\\\", 'If you dye or add color to your hair, select shampoos that will protect your treatment. Also, most shampoos have extra benefits such as volume and shine.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}