{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a53fa2d5-fed0-5a5f-814a-19571eedc419","task_key":"default--validation--42271","task_revision_id":"1","upstream_id":"42271","short_description":"HellaSwag validation 42271","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to kill tree roots [title] Cut small problem roots. [step] Although labor-intensive, this directly addresses the issue with no risk to nearby plants. Dig out the soil around and under the root first, then cut with a root saw or loppers.\",\"endings\":\"['Cut the root using a slight downhill angle. If desired, the roots should be small enough to penetrate the soil around them when they are cut.', '[substeps] You can use water or a tool to snip away the leaves of branches or or stems. Even simple pruning techniques may better fade the tree and minimize its ability to bear fruit.', 'Cutting roots aggressively can put the tree in a long decline, potentially killing it over many years. Follow these rules of thumb to prevent this : [substeps] Multiply the diameter of the tree by eight.', \\\"Keep the roots underneath the ground until they're completely underground. After that, place heavy rocks beneath the roots, or grab deep furrows with a kitchen spade.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}