{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3886c2d7-46a9-5bd5-8245-cb37c8d80477","task_key":"default--validation--16561","task_revision_id":"1","upstream_id":"16561","short_description":"HellaSwag validation 16561","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to prune apple trees [title] Know when to prune. [step] As soon as you realize your apple tree needs pruning, it can be tempting to jump to it and start lopping off branches immediately. However, it is important to prune at the right time to avoid damaging your tree.\",\"endings\":\"[\\\"Fresh, healthy fruit trees will be cut down faster to within three to four weeks of pruning. [substeps] Removing branches when they're a new color or shape will allow you to remove branches that're a little moldy and rot later.\\\", 'Prune in the first month or two of spring, at least two weeks after the last frost. [substeps] If you need to, pruning can occur later in the spring and early in the summer.', 'Plan to prune the tree in the fall before christmas. Planning to prune the tree after you know that it needs pruning will give you enough time to continue tending it throughout the year.', '[substeps] When you first notice that the trees are starting to wilt and die-the ideal time to prune is late summer or any time during the summer season. When possible, prune from june-before the first notice of a frost or if you see a frost.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}