{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9e6e50ff-d9ec-5aa3-b02f-82824b4584ea","task_key":"default--validation--29562","task_revision_id":"1","upstream_id":"29562","short_description":"HellaSwag validation 29562","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean a white leather purse [title] Wipe down your bag once a week with a microfiber cloth. [step] If your bag is pretty clean, use a dry microfiber cloth to wipe it down weekly. To remove minor dirt, mix a drop or two of mild soap and 8-12 ounces of warm water together.\",\"endings\":\"[\\\"Wring or throw out the cloth after every use and keep it next to your bag to absorb excess water. [substeps] If you have a receipt for your monthly washer and dryer session and the bag shows up leaking, don't wash it.\\\", 'Lightly dampen the microfiber cloth with the solution and wipe the dirt off the leather. [title] Dry the surface immediately after using a damp cloth.', \\\"Squeeze out any excess water before placing your bag in the washing machine. [title] Clean your bag's lining and crevices with a wet washcloth or dish towel.\\\", 'Squirt a little bit of mild dish soap into the bag. Wipe down your bag in a moving motion and then scrub the insides with the dry microfiber cloth.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}