{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a0927c23-5062-5eaa-823d-1465ec2a0f16","task_key":"default--validation--24331","task_revision_id":"1","upstream_id":"24331","short_description":"HellaSwag validation 24331","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to grow vegetables [title] Decide if you want to plant vegetables in the ground, in raised beds, or in containers. [step] Each of these options has its own advantages and disadvantages, so consider your situation before you decide to determine which method will work best for you. [substeps] Planting in the ground is great if you have good soil and don't mind getting down on your hands and knees.\",\"endings\":\"['It is great if you prefer to do it in open space as long as it gets enough sun. You can grow vegetables underground or from the floor of the house.', \\\"It is often the best option if you want to grow large amounts of vegetables. Raised beds work well if you don't have very good soil and/or you have a bad back.\\\", 'Planting in a raised bed is a great way to plant vegetables without a lot of soil. It works by transferring oil or clay into the soil and encourages oxygen to build up, and helps the plants grow well.', 'Planting in the ground makes your soil easier for vegetables to grow in. It can also prevent the budding of vegetables by exposing them to sunlight.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}