{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27a0e9ef-c72d-5e19-b09d-c6cc6dae04ff","task_key":"default--validation--18975","task_revision_id":"1","upstream_id":"18975","short_description":"HellaSwag validation 18975","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to not take yourself too seriously [title] Laugh at yourself often. [step] Life is going to throw a lot of curves your way and finding humor in less than ideal situations can be very useful. Put things in perspective.\",\"endings\":\"[\\\"If you have a flat tire or a bad public speaking moment, take a step back and realize it's not the end of the world. [substeps] If someone says something hurtful to you, be the first to laugh at yourself.\\\", 'Sometimes, you may have an odd favorite sport or hobby that you\\\\'ve been eyeing constantly, but can no longer match this. Even if there is no such thing as \\\" why not \\\" or \\\" you look dull? \\\" it doesn\\\\'t fit, and it definitely doesn\\\\'t fit into you.', 'Everyone has your best interests at heart and always has a fellow individual who is always laughing and making jokes. [substeps] Find a time to do everything for fun.', \\\"Don't turn into a stage mother when there's still some fun happening around you, cut it into ways you may enjoy what you're doing. [substeps] Finding humour can be a lot easier and more rewarding when you're actually enjoying life.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}