{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"83c63291-77c5-51d5-8ba6-cdbdceee1090","task_key":"default--validation--20259","task_revision_id":"1","upstream_id":"20259","short_description":"HellaSwag validation 20259","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to clean suede gloves [title] Check your gloves' care tags. [step] Before you begin cleaning your suede gloves, check the care tags. There are a lot of different types of suede and suede finishes, and each type has different care needs.\",\"endings\":\"['Learn about each individual suede product and its care signs to ensure you make the right cleanser. [substeps] The care signs for gloves should be number 1 or the latest amount and level of use.', 'The tags should tell you the best process for cleaning your type of suede. [substeps] For example, you should not use water on very fine suede, since the water will likely stain it.', 'You should check these care tags to see if your item (or product) specifically needs to be cleaned or pressed before caring for it. [substeps] You can check your care tag by pulling out a cardboard box or hand-washing it in your washing machine.', 'Items like suede pots, pans, and bins will have different care shots you must follow. [substeps] Ask the retailer to make a call or to send you your basic cleaning kit.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}