{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00d4ad31-f75e-5bec-8ad2-83006dbf0596","task_key":"default--validation--4014","task_revision_id":"1","upstream_id":"4014","short_description":"HellaSwag validation 4014","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to force forsythia blossoms [title] Check for new buds on the branches in early to late winter. [step] Depending on your climate, you should begin checking forsythia branches every few days for new flower buds in december, january or february. In usda hardiness zones 8 and 9, begin checking in december as these shrubs can begin to bloom by the end of january.\",\"endings\":\"['These buds are most likely to start blooming between early october to mid july. Use annual zaletti plant mullein mixed with the tips of and in a biological lab to help fertilize any new, healthy buds.', 'In zones 5 through 7, begin checking in january or february. [substeps] These buds will appear small, elongated, and pointed and green or yellowish in color, encircling the branch all along its length.', '[substeps] If you live in an area that gets heavy snowfall regularly, wait until winter is over and try to prune in late november. You can also prune in the early spring, if you live near a highway or in the forest.', '[substeps] Start by inspecting any branches growing outwards from the canopy of the tree, such as the branches above. If you spot any growth coming inwards from the branches, they can likely be forsythia buds.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}