{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"49a15ab4-dc82-5382-bf1e-76df69b1ca94","task_key":"default--validation--14138","task_revision_id":"1","upstream_id":"14138","short_description":"HellaSwag validation 14138","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stay cool and feel fresh during the summer [title] Shower every day. [step] Use exfoliating shower gel to clean off the grime. Turn the water to hot to start the shower (because it cleans you more effectively), but towards the end of your shower, turn the water to a lukewarm or cool setting.\",\"endings\":\"[\\\"You should get the water hot enough to flush out the dirt and dead skin that hangs over your face. Apply body soap (or leave it open to air) to your skin's surface in short bursts.\\\", 'This lowers your body temperature to make you feel cooler (and wakes you right up in the morning! ). [title] Moisturize right after you step out of the shower.', 'Apply this gel to the sweat under your arms or body. Think of it like flushing one armpit with water (you can make your own shower gel with your arms or legs and you can wash some off immediately.', 'Alternatively, open the door to let cool water flow through the open window for at least an hour. [substeps] Use a facemask while showering.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}