{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"661ccfb8-eed5-5b37-aebe-aeaa90dcef7f","task_key":"default--validation--29659","task_revision_id":"1","upstream_id":"29659","short_description":"HellaSwag validation 29659","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to deal with black spot leaf disease [title] Prune infected leaves immediately. [step] Ensure the overall health of your plant by removing diseased leaves entirely. To prevent the spread of disease through contact with the plant or soil, throw them away immediately with your regular trash before doing any more work in the area.\",\"endings\":\"['[substeps] Donate diseased leaves to a local charity or candidate. Alternatively, if you collect diseased leaves or do not have access to a recycling source, ask the national organization to gather and distribute them.', '[substeps] If your black leaf difficulties do not clear up on their own, the fungus can still spread and contribute to leaf discoloration. At best, it might be safe to prune one part of the affected plant more frequently as it becomes infected.', '[substeps] If the affected leaves are visible (appropriately or if the foliage is dirty), treat any affected leaves immediately. Stop pruning early and check the area again in a couple of weeks to help prevent further infestation.', 'Further prevent the disease from spreading by disinfecting your tool immediately after pruning each leaf. Have a solution of 1-part bleach to 4-parts water within easy reach..']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}