{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"88049e82-24b5-588d-913c-73ba699789f2","task_key":"default--validation--26840","task_revision_id":"1","upstream_id":"26840","short_description":"HellaSwag validation 26840","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to protect grapes from insects [title] Cover your grape vines with fine mesh netting to protect the grapes. [step] The mesh should be between 0.5 to 0.8 millimetres (0.020 to 0.031 in) to protect the grapes from flies, moths, beetles, and other larger insects. The mesh creates a barrier and reduces the need to use chemicals.\",\"endings\":\"['[substeps] It can be tried using potting trays, or flower pots. [title] Ensure no flies near the grape plants.', '[substeps] Mesh netting also protects your grapes from birds and small mammals that could be pests. Sunlight and water can still penetrate the netting, so there is no need to worry about removing it to care for your vines.', '[title] Keep your grape vines moist throughout the growing season to help speed the ripening process. [step] Bees do a lot of maintenance of the vines during the summer season to ensure that they will produce good fruit.', '[substeps] Additionally, bags of netting should be equipped with handles to lift up the leaves of your vines as many insects can sneak in through cracks. Larger plants, like fruit trees, grapes, and fruit bushes should be covered tightly to protect them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}