{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41a72711-4bc0-508a-a088-906e8b192271","task_key":"default--validation--46413","task_revision_id":"1","upstream_id":"46413","short_description":"HellaSwag validation 46413","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to take care of a tree [title] Water your tree thoroughly right after you plant it. [step] Watering your tree right away will help settle the soil and mulch, and it will give the roots moisture they need to start growing. Don't soak the soil around your tree.\",\"endings\":\"[\\\"[title] Water the tree only 2-3 times per week. [step] You'll need a watering will you are two times daily.\\\", \\\"Watering even a slight amount can significantly lower the tree's winter foliage and promote root rot. [substeps] Avoid watering your tree in the evening.\\\", 'Spraying it with a gardening hose for 30 seconds should give it enough water. [title] Keep the soil moist if your tree is less than 2 years old.', \\\"It's important that the roots and mulch dry before watering. [substeps] If you have a young tree, add one or more drops of concentrated sap every minute or two during the growing season.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}