{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab1343ce-bc64-59fb-91be-ba1831c30fd7","task_key":"default--validation--49219--variant-da2ca9810f9c","task_revision_id":"1","upstream_id":"49219--variant-da2ca9810f9c","short_description":"HellaSwag validation 49219","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to improve your personal integrity [title] Live with honesty and keep your promises. [step] Honesty is one of the most important aspects of integrity. If you are dishonest or misleading with others, you cannot live a life of integrity.\",\"endings\":\"['Part of being honest with others also includes keeping any promises that you make. A broken promise is effectively a lie, and lying is inconsistent with living with integrity.', 'When you find out someone has cheated on you, do not immediately respond with anger or frustration. Instead, take ownership for your behavior and let go of all pent up frustration.', 'Instead, you must maintain honest behavior and morals. [substeps] Organize your thoughts in a logical fashion.', \\\"Always be honest with your family, friends, teachers, coworkers, and partners. Some lessons to keep in mind include : [substeps] People who lie are at higher risk of injury and worry than those who don't lie.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}