{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe4652e6-3128-531f-ab9e-3c446035e8b3","task_key":"default--validation--5849","task_revision_id":"1","upstream_id":"5849","short_description":"HellaSwag validation 5849","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use exfoliators [title] Use a scrubbing pad or cloth if you don't like exfoliating products. [step] Mechanical exfoliation involves scrubbing your skin with some sort of abrasive pad or cloth or using a product with gritty particles or beads. The simplest way to remove dead skin cells is scrubbing it with a moist or wet cotton face cloth.\",\"endings\":\"['[title] Shop for a manual exfoliator. [step] Household exfoliators allow you to always mix at least one into your scrub, such as rock salt, yeast, or powder.', \\\"Cotton is soft and not especially abrasive, so you're removing dead skin mainly by friction. Wash your skin with warm water and a gentle cleanser prior to exfoliating to open up your pores a little better.\\\", '[title] Combine the facial cleanser and lotion. [step] Find a mild, non-acidic cleanser that is acidic but not overly abrasive.', 'Paper towels are a good product for exfoliating. [substeps] If you have lots of skin cells under your fingernails, or dirt or grime on your hands, you could use a damp washcloth.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}