{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8dab5f46-20e4-58b4-9d5f-37bdc35e0699","task_key":"default--validation--39464--variant-29941a76c871","task_revision_id":"1","upstream_id":"39464--variant-29941a76c871","short_description":"HellaSwag validation 39464","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style wavy hair [title] Wash and condition your hair. [step] Before you begin to style your hair, you'll want to wash it so that it is in it's natural state. If you try to style your hair wavy after you have already styled it another way, it may be more difficult.\",\"endings\":\"['Follow your shampooing and drying routine to improve how naturally wavy your hair is. [substeps] When you shampoo and condition your hair, use a moisturizing shampoo or conditioners such as dove, which are available in small bottle forms.', 'Wait a few minutes to shampoo and condition it. However, it is better to err on the side of caution and go with the natural process.', 'If you want to keep your style looking sleek and relaxed throughout the day, your style will be most important. [substeps] Rinse and condition your hair thoroughly before you start styling.', 'Use a shampoo and conditioner that enhances wavy hair. [substeps] When you visit your local cosmetics or grocery store, look for a shampoo and conditioner that is suited for wavy or curly hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}