{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3dfb465-af69-5bde-838c-67095c0a358e","task_key":"default--validation--17642","task_revision_id":"1","upstream_id":"17642","short_description":"HellaSwag validation 17642","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to prepare your garden for winter [title] Bring less hardy plants inside. [step] Some of your plants won't have died yet, but they won't be strong enough to withstand the winter weather. You'll want to research the specific plants you have in your garden and find out which ones can be easily moved inside for the winter.\",\"endings\":\"[\\\"[substeps] This is especially true if plants are winter-hardy. As in any other outdoor garden, make sure you aren't growing plants that cannot be moved outside of their current conditions.\\\", \\\"You could move them to a greenhouse, your garage, or even inside. [substeps] If you do this, you'll need to carefully dig them up and replant them into an appropriate pot.\\\", \\\"[substeps] Plants that would require to be moved inside for less than a week can be stored for one month. Consider checking with gardening center authorities to determine if you should include plants in your garden that haven't died because they were exposed to too much sun.\\\", \\\"[substeps] If you live in a climate with harsh winters, you may want to consider adding plants or shrubs to your garden. You'll want to choose plants or shrubs that are not suited to the freezing weather and will be easy to move inside.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}