{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2798e196-daa7-5f07-8c83-ee461c194690","task_key":"default--validation--35850","task_revision_id":"1","upstream_id":"35850","short_description":"HellaSwag validation 35850","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply liquid lipstick [title] Prep your lips with moisturizing lip balm. [step] Liquid lipstick stays on for a long time and this can dry out your lips. To keep your lips moisturized, apply some moisturizing lip balm to your lips before you apply the liquid lipstick.\",\"endings\":\"['Simply rub a pea-sized amount of lip balm into your lips, then wait five to ten minutes and then pull off the lip balm. [substeps] Lip balm, on the other hand, is supposed to be applied directly to the lips.', \\\"Be sure to choose a moisturizing lip balm specifically designed for lips. This will make the liquid lipstick last longer and won't make lip sectioning any more difficult.\\\", 'This will help prevent lip pain and flare-ups. [substeps] You can use a dark lip gloss that matches the lipstick shade you choose for your lips or incorporate a lip protector to keep the lips moisturized.', '[substeps] Look for a lip balm that is wax based for extra protection, such as a beeswax lip balm. [title] Apply some highlighter around your lip line.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}