{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7590b58-c1b6-5d34-9f0d-6bbf455bee80","task_key":"default--validation--4004","task_revision_id":"1","upstream_id":"4004","short_description":"HellaSwag validation 4004","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to keep black jeans from fading [title] Wash your jeans by hand in cold water. [step] Cold water helps reduce the denim's dye from bleeding. Use a natural soap and don't apply too much pressure when scrubbing.\",\"endings\":\"[\\\"Soak your jeans for a couple minutes and then let them dry on a hanger. [substeps] You can effectively wash and soak your jeans in your kitchen sink, as long as it's clean.\\\", \\\"Keeping it in your jeans allows the dye to penetrate deeper and will keep the fabric from drying out. [substeps] It's best not to use all-purpose wash cloths, as that will stain your jeans or leave behind a discoloration.\\\", 'The cold water weakens the fabric, not only making it less likely to bleed, but also opening pores. Run cool, running water through your jeans to get the excess water out.', 'Otherwise, the bleaching process could leave a visible discoloration. To wash and dry a pair of distressed jeans : [substeps] Use a wet cloth to wipe the area dry.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}