{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5e49f5f-0c66-5e45-b62f-1f04c1e48617","task_key":"default--validation--6145--variant-bd917e43beca","task_revision_id":"1","upstream_id":"6145--variant-bd917e43beca","short_description":"HellaSwag validation 6145","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to promote your business through newsletters [title] Create a simple newsletter template in microsoft word, but if you have microsoft publisher, you can create a fancier template. [step] You have plenty of newsletter template options within microsoft publisher, but if you don't like any of those, check out the online template collection at microsoft office online. [title] Click on the template you want to use.\",\"endings\":\"['[step] It should be sitting on a pushup bar directly in front of you in microsoft office. Once you first see it, click on the button with the name \\\" create template.', '[step] Click on create site to create a sponsored newsletter. Then click on \\\" buy it! \\\" but keep in mind, you will wish to entice a balance between sales and expansion in your newsletter.', '[step] In the customize box, choose the color scheme you want. Using the same colors that are in your logo or other branding materials is a nice touch for a sense of consistency.', \\\"[step] If you keep seeing a number of templates that interest you or that are up for adoption right now, click directly on the template you want to use. There's no need to go right click on the description.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}