{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23501a88-0155-57fc-9fae-ed4d47b57be7","task_key":"default--validation--17989","task_revision_id":"1","upstream_id":"17989","short_description":"HellaSwag validation 17989","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to heal cracked skin on fingers [title] Treat deep cracks. [step] If you have cracks that are deep enough to bleed, you'll need to care for them the same way you would any open wound. Wash the cracks carefully with warm soapy water, dry them gently, and apply bandages.\",\"endings\":\"['Using an antibacterial ointment will also help to protect the cracks and keep them from getting infected. [title] Slather your hands in moisturizing cream.', 'Wash your hands after you are done, or soak them in a bucket of warm water for the moment before continuing. [substeps] If you are using a gauze pad or a gauze thread to apply bandages, you will want to wrap your hands in a towel to protect your hands.', 'Once the crack has been healed, replace the bandage and apply ointment. [substeps] Apply a topical antibiotic to the crack.', 'Watch out for signs of infection such as redness or swelling, blisters, or dryness. [substeps] Do not apply a band-aid over cracks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}