{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2a4cad0-93d3-5db0-ad9d-e5c2ef642f1a","task_key":"default--validation--40902","task_revision_id":"1","upstream_id":"40902","short_description":"HellaSwag validation 40902","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to avoid hair color that ages you [title] Stay close to your natural shade. [step] Work on enhancing and enriching your natural hair color instead of introducing an entirely new color. For example, dark brunettes should keep their rich tones and warm blondes should stick to golden tones.\",\"endings\":\"['Avoid aging your hair by staying at the latest trends. Identify only those hair colors that you like and bring them to your hairdresser for approval.', 'Deviating from the norm may lead to clumping, brittle hair. In addition, washing your hair often improves existing locks.', 'Either go your hair color home and dye it a darker blonde, or, even better, flesh out blonde colors for a slightly more polished look. [substeps] Use dye, sulfate-free shampoos, and oils to keep your hair healthy while keeping dark colors from fading out.', \\\"These tones compliment your skin's complexion, helping you look younger and more natural. [substeps] Making a drastic hair color change tends to be aging.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}