{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ca99b90-e205-5511-8a75-93d8973758e4","task_key":"default--validation--33182","task_revision_id":"1","upstream_id":"33182","short_description":"HellaSwag validation 33182","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to build trust [title] Do what you say. [step] One of the most important steps in building a foundation of trust is to do what you say you will do. Even if it is a small thing, canceling or failing to follow through will create hairline fractures in your trustworthiness.\",\"endings\":\"['Even something as minor as dissolving your lease agreement in front of a trusted friend or family member will not be enough to rebuild trust. Be sure that you follow through with your word, but open with this person in mind.', '[substeps] Perfectionism occurs when you assume nothing will happen, absolutely from the start. Believe that everything will fall neatly into place, everything is going to be okay, all things will be okay.', \\\"A great example of this is... [substeps] Never rent or buy anyone's house.\\\", '[substeps] Although the occasional failure to follow through may not seem like a big deal; repeated failures can add up. Over time, people in your life may come to see you as less trustworthy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}