{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec190a82-0a25-5304-81ba-7b1dc64d1cb6","task_key":"default--validation--6454","task_revision_id":"1","upstream_id":"6454","short_description":"HellaSwag validation 6454","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to avoid mercury in your skin products [title] Recognize common products that use mercury. [step] There may be mercury lurking in many of your skin care products. However, some are more likely to contain it.\",\"endings\":\"['The common types include : [substeps] Mineral oil prescription hydrogen peroxide baking soda diogenes (example used are acidophilus and ciprofloxacin) dissolved retinoids [title] Rinse your face. [step] Use a mild, baby soap or bathwater.', \\\"Check any of the following to see if they contain mercury : [substeps] Skin creams, especially anti-aging and skin lightening beauty and antiseptic soaps lotions [title] Read the product label for mercury synonyms. [step] Since mercury doesn't have a distinctive smell or color, the only way to tell if it is in a product is to read the labeling.\\\", 'Common products used in underarm hygiene include : [substeps] Moisturizers acne-effective fabric. These products are generally available for cosmetic use, including groceries, jeans, and sweatshirts.', 'Regardless of the product you choose, when you apply the product, you should wait 24 hours before applying it to your face or hair. [substeps] While \\\" pure pure \\\" generally refers to most cosmetics, make sure to refer to the label to see if it is over the counter, and limit your use to only half and half.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}