{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"985d3b82-a944-5129-bf7a-3f5714c2b2c3","task_key":"default--validation--15056","task_revision_id":"1","upstream_id":"15056","short_description":"HellaSwag validation 15056","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to market your brand new web site [title] Add your website address to all email signature lines. [step] Make sure every outgoing email has your web address listed. [title] Send an email to your clients announcing the launch of your new web site and ask them to go take a look at your site and give you feedback.\",\"endings\":\"[\\\"[step] Include a page address, middle initial and a page press to let clients know why you're related. [title] Decide how the sales information you provide is to be noticed.\\\", '[step] Once you have their email address, open the email to detect any questionable discontinuances. Not all email is, though, so do the most important things in order to attract more people.', '[step] Follow these guidelines as much as possible, but if you would like, copy different templates into them, depending on your market and consulting software, for example. [title] Send out more in daily newsletters daily to your customers, so that these messages will remain on your website.', \\\"[title] Make sure your site is added to all local searches on yahoo, google maps, yelp and any free directories. [title] Add your website to your business cards (you wouldn't believe how many people forget to do this important step).\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}