{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5fe40d77-f082-5c07-869c-48da801c1fb9","task_key":"default--validation--25430","task_revision_id":"1","upstream_id":"25430","short_description":"HellaSwag validation 25430","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to check if vegetables are spoiled [title] Check your leafy green vegetables for discoloration and odors. [step] Green vegetables will wilt after a couple days, especially if they're unpackaged. That is okay and doesn't mean they are spoiled.\",\"endings\":\"['Greens that are close to spoiling will start turning a yellowish color, become slimy, and have a foul odor. [substeps] You can revitalize leafy greens by soaking their stems in warm water for 10 to 15 minutes.', '[substeps] For fresh green vegetables, check where they used to be. Decompressing can cause skin damage.', \\\"But you can check over any and all soups or stews you cook as well. You can also check the juice on your pot's lid for any residue.\\\", \\\"In fact, spoiled vegetables can cause significant health problems, which can include : [substeps] Loss of flavor loss of flavor change in taste [title] Check the salt content. [step] When handling vegetables, it's important to check the salt content.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}