{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"057970bc-6827-5d03-bad9-9af5658e2356","task_key":"default--validation--46043","task_revision_id":"1","upstream_id":"46043","short_description":"HellaSwag validation 46043","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prevent jeans from fading in the wash [title] Wash jeans infrequently. [step] Jeans do not actually need to be washed as regularly as other clothing items. In fact, washing jeans too often can cause them to fade prematurely.\",\"endings\":\"[\\\"On average, around thirty minutes a week should suffice for a pair of jeans, as jeans generally absorb water more quickly than other clothing items. [substeps] If you're washing your jeans for a job, or for a store-bought measurement, keep in mind that wash will not very often begin to take color out of jeans.\\\", '[substeps] You really only need to machine wash jeans once ever 4 to 6 weeks. If you notice any stains during this time frame, you can spot clean with household cleaners rather than throwing the jeans in the wash.', 'However, wearing jeans regularly, especially for short periods of time, can help slow down the fading process. [substeps] Make sure you wash your jeans weekly, or more, if you have lots of wear.', 'Jeans can be fading longer with repeated washing cycles, though. Because of this, you should be careful washing jeans before wearing them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}