{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ed34bf7-53db-5857-91b1-e2a7a75a410a","task_key":"default--validation--21973","task_revision_id":"1","upstream_id":"21973","short_description":"HellaSwag validation 21973","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to put on a loincloth [title] Use leather for a comfortable and durable loincloth. [step] Leather is a common material used in most loincloths. Try using leather for a more durable and traditional loincloth.\",\"endings\":\"['They provide great protection against the elements and are more and more comfortable. They are long and stick to the lower body, though they can also be added with feathers.', \\\"Cloth looks appropriate compared to other fabrics and also hides some of the body's flaws so you look a bit like that particular man. [substeps] Leather, on average, is a breathable, breathable material (especially when it's slept on).\\\", 'Cooler areas are probably best, as they do not provide as much material and can be more expensive. However, the lightcloth should be fairly breathable, as it will prevent excessive sweating.', 'However, leather can be quite warm and is not a very breathable material. Certain leathers can be bought in bulk at various fabric or textile supply stores.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}