{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2a53541-fe1c-5a32-a21a-8ff9ebd20668","task_key":"default--validation--6267","task_revision_id":"1","upstream_id":"6267","short_description":"HellaSwag validation 6267","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prune ornamental grasses [title] Wait until late in the season to cut brown or spent grass. [step] You want to cut back your grass once a year, as late in the season as possible. For warm season grasses, you want to trim them between late fall and mid-spring.\",\"endings\":\"['The dark season grasses, near the middle of the fall, are unsightly for the best grow as they are less likely to start consuming nutrients. [substeps] Morning and evening landscaping is best, but you can let your east american neighbor know as well.', 'The leaves are better to put away and keep than medium color grasses that require less direct sunlight. [substeps] If you plan to leave the grasses on the lawn, keep the grass trimmed short to keep the grass from overgrowing.', \\\"For cooler season grasses, wait until late summer to deadhead your grasses. Your yard's humidity level will vary, though a strict wood-ash rule works well.\\\", 'For cool season grasses, cut them back in early spring. Cutting your grass in the wrong season can impact its ability to grow and pollinate.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}