{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6e7ce950-93b4-5b7f-b32a-ecba6ffdac02","task_key":"default--validation--37659","task_revision_id":"1","upstream_id":"37659","short_description":"HellaSwag validation 37659","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get a divorce in nevada [title] Schedule a time to talk with your spouse. [step] For an uncontested divorce, meet with your spouse to discuss the terms and come to an agreement. Set aside several hours for the two of you to talk alone.\",\"endings\":\"[\\\"Send the children to visit friends so that you won't be interrupted. You probably will need several meetings before you can reach agreement on important issues.\\\", 'Plan to meet away from the courthouse or to a private room with good lighting. [substeps] Remember, your finances are fairly low.', '[substeps] Agree on some type of agreement so that you can be in touch with each other when you need to come to an agreement. Keep in mind that many courts will require that a contested divorce be considered uncontested in an agreement.', 'You may want to place a request to speak with your spouse over phone, skype, or even text messaging so that the possibility of speaking in person is less of a burden. [substeps] If you have children together, schedule time for them to get to know your spouse.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}