{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2b23779-6d43-5060-8d4b-472f9e3ef676","task_key":"default--validation--4836","task_revision_id":"1","upstream_id":"4836","short_description":"HellaSwag validation 4836","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a wedding officiant [title] Check your state's laws. [step] A wedding officiant is fulfilling the legal duty of certifying a marriage license so it's important to understand the law in your state. [substeps] Visit your state's secretary of state website to see which laws apply.\",\"endings\":\"[\\\"Although you don't need to do this to become a wedding officiant, you should do it according to state laws. If you live in an area where such laws apply, keep yourself informed of those laws and methods in your state.\\\", 'There are no regulations that require a marriage officiant to perform a wedding in your state. In most states your officiant must be at least 18 and older than you.', \\\"If you'd like to prove officiant duties in your state, check with your local attorney. If you've never officiated a wedding in your state before, do so before completing the marriage license application (with irs form 5536).\\\", 'Some states are very lenient with who can become an officiant, but others require officiants to be a practicing minister with a congregation. Some states will impose a fine for any marriages officiated illegally.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}