{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec6ccdf2-2c3a-531f-a3a9-83f7a9aea559","task_key":"default--validation--27712","task_revision_id":"1","upstream_id":"27712","short_description":"HellaSwag validation 27712","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get adult kids to pay their share [title] Have a family fiscal meeting. [step] It is definitely time to stop babying now. They're adults and they can take the hard facts.\",\"endings\":\"['You will want to do everything you can to cover everything, every penny that will go into their paycheck. Enjoy your newfound wealth while it is giving you a clear start-over.', 'A small party [title] Connect traditional conversations with family. [step] In order to get permission from them, it is best to get their input on large decisions.', \\\"Explain to them the costs involved in keeping them, ranging from food, electricity, gas, maintenance of the home, clothing, cooking services, cleaning to providing a rent-free room. If you have been offering these things free-of-charge, it may well be that your kids just don't see the harsh reality of the costs involved.\\\", \\\"No one's life is too short to have an adult listen to them. [substeps] When you're in a situation where they're frustrated, have them sit down and brainstorm a list of how they need to make their allowance more reasonable.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}