{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"670a812a-2e18-56ce-9192-6f0332056282","task_key":"default--validation--5289--variant-8102b4f69661","task_revision_id":"1","upstream_id":"5289--variant-8102b4f69661","short_description":"HellaSwag validation 5289","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be beautiful when you have a disability [title] Accept that you're beautiful the way you are. [step] Everyone is different and special in their own way. This makes us all unique and beautiful.\",\"endings\":\"['Shyness can be contagious, so focus on being unaware of everything you do and say. [substeps] Some studies suggest that people should be seen for their outgoing, passionate, and realistic energy.', 'Thinking your disability has made you ugly will only make you self-conscious and uncomfortable. True beauty shines from the inside out.', 'Accept that! [substeps] Look in the mirror and appreciate who you are by painting or painting your. Call yourself a unique name, carry a handbag, or sit under 3d lights.', '[substeps] The people we love are those who know us and work for us, who know us well as people who make us happy and critical of ourselves. People who acknowledge our individuality and might even accept us as we are.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}