{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ade15e9-e0aa-56c0-8380-4fe019f19f90","task_key":"default--validation--11162","task_revision_id":"1","upstream_id":"11162","short_description":"HellaSwag validation 11162","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to control cutworms [title] Know the signs of a cutworm infestation. [step] You won't see cutworms during the day, since they feed at night. Most gardeners don't know they have a cutworm problem until they see evidence in the morning after a night of feasting has occurred.\",\"endings\":\"['One of the most common early signs of a cutworm infestation is the presence of a yellow worm or black worm. [substeps] Of course, bites and mites, though many gardeners can find them themselves, can also be mistaken for fleas and ticks.', 'If you see patches of hungry, diseased flesh that appear unhealthy and are no longer healthy, start fencing your garden and moving it to an area where the pests will be eliminated. [substeps] Ask your neighbors how they think a cutworm is infesting their crop.', \\\"By then, there's no telling how many worms are in the garden. Catching the population before it explodes will help save your garden.\\\", 'You are most likely to see a cutworm if you experience any of the following symptoms : [substeps] Brown legs: a parasitic cutworm infested by mites. White eyes: a cutworm that remains infested for a few days.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}