{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dfef2eba-7b64-59a9-9063-a6a00ff6cc65","task_key":"default--validation--49911","task_revision_id":"1","upstream_id":"49911","short_description":"HellaSwag validation 49911","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to plant pansies in containers and pots [title] Consider buying container-grown pansies from seed or bedding plants. [step] Pansies are easy to grow from seed and seed growing is usually the most economical way to obtain pansy plants. [substeps] However, pansies can be purchased from a nursery such as bedding plants or plug plants.\",\"endings\":\"['Boxmatter and perlite are popular options, but you can grow pansies from seeds. Pansies grow best in terracotta pots, so a pot with rolled-up paper noodles or a pot in plastic outdoor bins is a better place to grow your pansies.', 'They are usually available in spring and fall. If you purchase pansies in the fall, they will need to be planted 6 weeks ahead of the first frosts.', 'Pansies that grow from seeds can be purchased from your local nursery as well. [title] Pick pansies for blue foliage, green stem bunches, small leaves, and no other unusual characteristics.', 'Pansies grow best from seed because they are tiny and low in density and tend to grow on the floor or walls of containers. Flowering pansies can last for years if cared for properly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}