{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"435c90e3-cfc8-5ca3-a77e-50c9d9568a68","task_key":"default--validation--43449","task_revision_id":"1","upstream_id":"43449","short_description":"HellaSwag validation 43449","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to keep in contact with your grandkids [title] Contact your grandchildren through video calls. [step] Technology is very helpful when it comes to staying in contact with your grandchildren. Grandparents can use facetime, skype, and other video chat programs to not only talk to their grandkids, but see them, as well.\",\"endings\":\"['Many of these services are free and are easy to use. [substeps] Facetime is exclusive to apple products, like iphones and macs.', \\\"Call your grandchildren with the intention of requesting skype over video calls and sending them pictures. Giving your grandkids the opportunity to play video chat with other grandkids while you're busy is the best way to keep in touch with them.\\\", 'You can just send them an email or post them on your social media platforms. If your grandkids are specifically the best at communicating with their grandparents, you may want to consider starting video calls for grandchildren who can use facetime or other video chat programs.', 'You may find that your grandkids respond the same way or that video calls bother them-you might be able to trace those phone calls. [substeps] The best way to stay in touch with your grandkids is to share videos from pinterest, at least.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}