{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"139c361c-3820-5b67-9623-482e623e9f90","task_key":"default--validation--30117","task_revision_id":"1","upstream_id":"30117","short_description":"HellaSwag validation 30117","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to heal over exfoliated skin [title] Detect over-exfoliated skin. [step] If you suspect you applied the wrong strength product, applied too much pressure, or used too many exfoliators at once, look for symptoms of over-exfoliated skin. These may include : [substeps] Redness flaking irritation burning sensation [title] Apply cool compresses.\",\"endings\":\"['[step] Fill a spray bottle with cool or hot water and dip a cotton ball in the fluid. Wring out the excess moisture and place the wet cotton ball on your face.', '[step] To address the ingrown hairs or scars, apply ice to the area. This will reduce blood flow to these areas and reduce your risk of infection or other noticeable scarring.', '[step] Gently press a cool, clean washcloth on skin you have over-exfoliated. Hold on your skin for a few minutes or until your skin feels less irritated.', '[step] Another common source of irritation during exfoliation is excessive rubbing of skin. Applying cool compresses to your skin can reduce the amount of friction your skin can generate under the pressure.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}