{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5bd400c7-b7e5-563a-b814-85ba39dc4031","task_key":"default--validation--46936","task_revision_id":"1","upstream_id":"46936","short_description":"HellaSwag validation 46936","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your cousin to like you [title] Reach out to her. [step] Re-establishing contact with your cousin will put you on the right path to gaining her trust and getting her to like you. Keep your first messages simple so that you do not overwhelm her, nor she you.\",\"endings\":\"['Offer her your card or a phone number so she can reach you via phone or email. If you have a younger cousin, ask her to be your friend.', '[substeps] In the first message, be specific. \\\" it sounds like you are really eager to bond with me because you could care less about my new hockey jersey.', '[substeps] Try \\\" hey aria, i\\\\'ve been meaning to drop by and see how things are! Would you be okay with waiting outside for me? I need a little support now and then. \\\" say, \\\" hey aria, i would like to talk to you some more about my cousin.', '[substeps] There are different ways to reach out to your cousin, including a letter, an email, or a phone call. Social media is also an option: you could (re) friend her on facebook or follow her on instagram.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}