{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"22977255-2420-5e0a-9e1b-9ba5f4838db0","task_key":"default--validation--986","task_revision_id":"1","upstream_id":"986","short_description":"HellaSwag validation 986","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to dry out dirt [title] Clear any debris. [step] Before you add anything to the dirt, you should make sure that all interfering debris has been cleared away from the area. [substeps] If you keep the debris in place, you may work undesirable material into the soil while working in the lime.\",\"endings\":\"['For example, you may be removing plants from the lawn beds that need frequent cleansing. If you have a garden sprayer, extend it towards a hose and squirt the soil around the roots.', 'If this is the case, you might consider putting a film over the area and digging a hole around the existing debris. You want to clean the area around the unwanted object before you begin working to prevent the object from falling apart.', 'The presence of surface debris can also cause the soil to retain more moisture by blocking potentially drying sunlight. At minimum, rake away soggy leaves and old mulch to clear the soil.', 'Gather a blanket or tarp and drape it over the dirt. Drape the blanket or tarp over as much of the stuck-on dirt as possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}