{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"76c6be50-471e-5cd1-b951-3682a81f077f","task_key":"default--validation--40577","task_revision_id":"1","upstream_id":"40577","short_description":"HellaSwag validation 40577","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to be a twitter celebrity [title] Tweet like a famous blogger. [step] Twitter is a micro-blogging tool; it's basically blogging in 280 characters or less in each tweet. Generally, the same guidelines for being a good blogger apply for being a good tweeter.\",\"endings\":\"['[substeps] Tweet \\\" @widbettydisputing91.net \\\" in an ad. Twitter posts cite the original twitter post, the tweet, and any other source that relates back to that post.', 'Opinions should be shared and there should be a diverse range of opinions about twitter status, content, and behaviors. [substeps] Magazines and sites are better sources of information.', '[substeps] Twitter needs facts and statistics to promote your products and services. Check out blogs and other websites before attempting the self-talk exercise: http: // twitter.com/tweets/0-constant [title] Use hashtags in your content.', 'You can\\\\'t expect a blog with only three posts on random topics to attract many subscribers, can you? [substeps] Choose your topic. If you want to be famous on twitter, don\\\\'t take their question (\\\" what are you doing right now? \\\") literally.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}