{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1c961fa-08fc-5946-bc3f-2a7365ec875a","task_key":"default--validation--39975","task_revision_id":"1","upstream_id":"39975","short_description":"HellaSwag validation 39975","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean adidas shoes [title] Shake off any dirt on your shoes. [step] Do it outside so dirt doesn't get all over your floor. Hit the soles of your shoes together a few times to help dislodge caked-on dirt and grime.\",\"endings\":\"['Then, rinse your feet in a solution of cold water and a fresh clean cloth to clean the soles. [substeps] Always use a mild detergent, such as chlorine or regular dish detergent, to clean shoes.', '[substeps] [title] Run a vacuum over the laces. [step] While the shoes are soaking, run your vacuum up and down through the laces.', '[substeps] Many shoe stores have foot wash stations or rows of clean shoes you can use to scrub away dirt and grime. These can be easily cleaned after use by wiping them down with a wet rag and a few drops of mild dish soap.', '[title] Remove stubborn dirt clumps on the soles with a dry, clean toothbrush. [step] Take the toothbrush and gently brush it back and forth over any dirt spots.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}