{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42e2d7c1-7efd-5b2c-a76c-e9018039046c","task_key":"default--validation--3638","task_revision_id":"1","upstream_id":"3638","short_description":"HellaSwag validation 3638","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to find an internet marketing mentor [title] Do some initial internet marketing research. [step] There are a number of useful books, youtube videos and blogs about internet marketing, where you can learn the basics, if you don't already. Internet marketing mentors can pick up where these methods leave off, helping you to turn the knowledge into part of your marketing plan.\",\"endings\":\"['For example, consider reading the great gatsby or acid ball book series. [substeps] Do some internet research prior to entering the field to find out what genre these books are for.', '[substeps] Another advantage of doing extensive research are that you will get to know the people on the forefront of the technology. Once you receive coaching, you will want to stay up to date on new methods by reading blogs, journals and ebooks.', \\\"[substeps] Go online with a few blogs with information pertaining to your project, and keep going until you've learned as much as you can. Most experts recommend low ranking blogs that highlight how or why websites use their technology as a way to engage with potential clients.\\\", '[title] Decide whether or not to use a specialized internet marketing service. [step] There are even companies that use the internet to do certain things that only other people would: create your own website, design it, have traffic the way you want.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}