{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e3bbc43-045c-5632-9a86-6446db64e709","task_key":"default--validation--14990","task_revision_id":"1","upstream_id":"14990","short_description":"HellaSwag validation 14990","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to privately sell a gun in virginia [title] List your gun. [step] There are many websites and print publications that will list your firearm for sale. Local trading posts may charge a fee, but you'll probably get the most local exposure.\",\"endings\":\"['Choosing a reputable online site will make it easier to find customers when you are trying to make your sale. [substeps] If you want to start selling your.45 while it is still in use, you will need to register with the local authorities and make it public domain.', '[title] Assess the production statistics of your firearm. [step] County guns are oldest and are now worth hundreds of dollars.', \\\"Before making your purchase, make sure that the website you find complies with the laws of your area. It's important to consider local law than state laws if a person tries to sell your gun, since local law is very often not.\\\", 'Vaguntrader.com is a free member forum where you can list your firearm for sale anywhere in the commonwealth. Stay away from craigslist and facebook marketplace; a firearm listing is against user terms and is likely to get deleted.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}