{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8572098d-9815-5e3a-b63a-b5670e569573","task_key":"default--validation--37672--variant-769ad6ecc572","task_revision_id":"1","upstream_id":"37672--variant-769ad6ecc572","short_description":"HellaSwag validation 37672","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to plant trees for a reforestation project [title] Contact your local extension office. [step] The people in the office can help you determine the type of tree species that grow well in your area and those that would work best for a reforestation project. [title] Order numerous seedlings.\",\"endings\":\"['[step] Ideally, you should arrange the trees in an area with plenty of vegetation as they grow. Aim for an area that is level and has adequate space for a full-grown tree, such as a nearby driveway, a small greenhouse, or a suburban home.', '[step] If you have nothing else nearby in your yard, a couple of seedlings can grow into a tree. You could buy planting tables, and the tables could cost a fortune! [step] There are websites that allow you to order.', '[step] Plan to plant reforestation trees at a 8 x 8-foot spacing. This would mean that you would need 681 reforestation seedlings per acre.', '[step] After you determine the number of trees you need, you can purchase a protractor. An inexpensive tool like a rocket launch tool will automatically place the seed into the select field (where the plant will grow), while a large tractor will stream a collection of other materials including the seedlings and the pumpkin seeds.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}