{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e43ffc8-c4cd-54af-a7bd-0098fb8c185a","task_key":"default--validation--2751","task_revision_id":"1","upstream_id":"2751","short_description":"HellaSwag validation 2751","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to flat iron hair [title] Use shampooing and conditioning products that are specially formulated to create straight or sleek hair. [step] You don't need to buy expensive hair products, anything you can find at your local drug store or beauty supply store will work fine. Just look for products that claim to be straightening and/or moisturizing.\",\"endings\":\"['[substeps] For example, studies show that the american hair association recommends replacing hair wax with acrylic sulfate which has lots of anti-inflammatory properties. [title] Buy a round brush or a very fine fine-toothed comb for when it gets really greasy.', \\\"However, be aware that many hair brands have been eliminated from your list. If your hair is not saying that it's straightening or moisturizing, see a stylist instead.\\\", '[substeps] When you shampoo and condition your hair the same way each time, it will help to create certain recommendations. Go back more than once and read labels, and see which ones are not damaging to your hair.', '[title] Pat your hair dry after getting out of the shower. [step] Use your towel to remove water from your hair by gently squeezing your hair in sections rather than harshly ruffling it dry.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}