{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e7dbe73-1136-54a9-a34e-47c107258afb","task_key":"default--validation--31202","task_revision_id":"1","upstream_id":"31202","short_description":"HellaSwag validation 31202","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to groom a beard [title] Invest in the right tools. [step] To properly trim your beard, you'll need a wide-toothed comb, scissors and a beard trimmer. Consider purchasing a pair of professional barber's scissors for daily maintenance and trimming flyaway hairs.\",\"endings\":\"['Invest in a quality beard trimmer for shaping and to trim consistent lengths. For the sake of convenience, consider buying a rechargeable cordless model.', \\\"However, not all beards require barber's scissors. Consider using a razor with blades that are set to clean all hair, even the part close to the scalp.\\\", \\\"This will ensure you use the right tool when cutting, and will keep your beard clean and trim for its full length. [substeps] If you're trying to save money or don't want to cut your beard, you may want to invest in a beard trimmer.\\\", 'You should also find a beard trimmer that cuts your beard into even sections. [substeps] Regular trimmers are good for beginners because they are good for picking out hairs and removing skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}