{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"58257aed-60a3-5f94-9b74-00304d60663c","task_key":"default--validation--43811","task_revision_id":"1","upstream_id":"43811","short_description":"HellaSwag validation 43811","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to kill chickweed [title] Apply a pre-emergent weed killer in september. [step] Select a pre-emergent weed killer designed to get rid of chickweed from your local lawn and garden store or online. Pre-emergent weed killer should be applied to the entire lawn, and is generally sprayed over the grass.\",\"endings\":\"['You can apply the pre-emergent weed killer using a brush, rake, broom, or your gardening knife. [substeps] For indoor weed killer, spray it on more than one area, or apply it on bare dirt or wood floors.', 'Follow the package instructions to determine how much to use. [substeps] Do not use pre-emergent weed killer if you have yet to seed your lawn, as it may prevent your grass from sprouting.', '[substeps] Look for a pre-emergent weed killer that is easy to detect, and avoid a weed killer that has a preemergent effect. You will be spraying the weed killer along both sides of the lawn so the weed killer will only get on the grass.', 'As you spread the weed killer over the grass, rake it in around the edges of the foundation to show that chickweed has been sprayed. If there are clumps of chickweed all over the lawn in your area, use fertilizer and weed killer on them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}