{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"809db1f2-a745-5d17-a8f8-eaadd4edf4f3","task_key":"default--validation--18433","task_revision_id":"1","upstream_id":"18433","short_description":"HellaSwag validation 18433","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be beautiful, just like lauren conrad [title] Gain self-confidence. [step] This may sound a bit clichéd, but confidence is the most beautiful quality in a person and lauren conrad has lots of it. You can't be afraid to be yourself or wear what you want.\",\"endings\":\"['She makes sure that you get what you want, and that you have an confidence that can grow. [substeps] The key to having an amazing self-confidence is losing it.', 'Confidence is most important for lauren to have. [title] Picture herself as a gorgeous goddess who is beautiful, no matter what.', \\\"The key step to being as beautiful as her is to be as confident as her. To be confident, you have to love who you are and don't beat yourself up.\\\", \\\"Dress up, wear a dress, and be nice with whomever you see. But remember that they're still you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}