{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"344fb697-f1b2-53fb-b900-2485844d354d","task_key":"default--validation--25083","task_revision_id":"1","upstream_id":"25083","short_description":"HellaSwag validation 25083","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to structure your ebay auctions for maximum success [title] Choose your title carefully. [step] You need to be very clear and specific in the title. People should be able to see at a glance exactly what you're selling.\",\"endings\":\"['If you give people the wrong title, then the sellers will gain a flat commission and, if your name becomes synonymous with the ebay option, you will lose future customers. [title] Select your category and set it up.', 'The title should get your potential customers interest and grab their attention right away. Spend a good deal of time crafting a killer title for your product.', 'You should also have a title worth both both to people and to yourself. If you are selling an item or line, you should always choose an ebay name and value that to your success.', \\\"Think about your title's purpose, your sort of product, and the level of competition you can expect to have in your auction catalogue. [substeps] You may want to choose a title that is easily recognizable or that will make it stand out from the crowd.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}