{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d511c5a0-e911-51d6-9630-d616e772d12f","task_key":"default--validation--14223","task_revision_id":"1","upstream_id":"14223","short_description":"HellaSwag validation 14223","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to buy collard greens [title] Identify collard greens. [step] In order to buy collard greens, you need to know what you are looking for. Collard greens are large in size, usually at least 10 to 12 inches long, with oval, flat leaves.\",\"endings\":\"['The leaves are usually olive, with equal parts dark brown and light brown. Collard greens are also known as poofy greens, such as yellow collard.', 'Each individual plant has their distinctive characteristics, and you must choose the varieties that appear most similar to each other in order to buy. [title] Select collard greens that have turned out well.', 'In comparison to kale, the leaves are usually wider and the stems are thicker. [substeps] If you are unsure about which greens in your store are collard greens, look for signage to indicate or markings on the ties that keep bunches of collards together.', \\\"They produce a large amount of manure and waste that can be deadly to animals. For this reason, you don't want to choose collard greens that have a large majority of manure and waste, such as corn and chicken manure.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}