{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23e034db-3b6b-5fc9-9b08-750515abde7d","task_key":"default--validation--34414","task_revision_id":"1","upstream_id":"34414","short_description":"HellaSwag validation 34414","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to join the army without your parents supporting you [title] Learn all you can about the army. [step] If you are well-informed on joining the military you will have a much better time convincing your parents that you are not making a rash decision. There are a lot of great websites online with information on all aspects of making the military your career.\",\"endings\":\"['This knowledge might help convince your parents to support your decision. [substeps] Use the tips and resources on the sites to learn things such as the enlistment process, the required asvab test, and the various types of training available.', \\\"You can actually learn more about the military for free using cyberdating. You'll not only learn more from internet tips but also from the military.\\\", 'On twitter, for example, there are sites that offer information on how to be a soldier in the military. [substeps] While online news sites provide information all the time, they can also introduce you to other military careers that offer an interview about your field.', '[substeps] Some of the websites are also free from spotify and e-reader. Some also have links to actual events you will see on the sites.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}