{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"819d8076-8773-5821-a79f-77e3935a204f","task_key":"default--validation--29703","task_revision_id":"1","upstream_id":"29703","short_description":"HellaSwag validation 29703","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to add social networking icons to your blog [title] Decide which social networks you want to list on your blog. [step] The most popular icons include facebook, twitter, linkedin and pinterest. [substeps] Choose social networking spots where you and your blog readers are active.\",\"endings\":\"['Try google or bing in order to find the most popular. Share your posts along with other people who share similar interests or topics as you.', \\\"Create a new page every 20 to 30 days or as soon as your post/comment is received on your blog. You can adjust this time, but it doesn't have to be.\\\", 'For example, if you have a great facebook page, you will want to include that icon. If you want to encourage your readers to pin your blog onto their pinterest boards, be sure you have that icon present.', 'Stand out by choosing your public, private or private profile. The more dedicated you are to making these public profiles, the more likely you are to get targeted.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}