{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"185881ae-e239-558c-9a63-cf6280c7ea04","task_key":"default--validation--13493","task_revision_id":"1","upstream_id":"13493","short_description":"HellaSwag validation 13493","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get married in new mexico [title] Secure a marriage license in the state of new mexico. [substeps] Visit the county probate court or circuit court in your area. There is currently no residency requirement in the state of new mexico, and your marriage license should be good throughout the entire state.\",\"endings\":\"[\\\"You must be 18 years of age or older to get a marriage license in new mexico. If you are not, you will need a parent's consent.\\\", 'Permits from the clerk to get married vary by state, so make sure you talk to a trusted organization (such as a county manager) or a government agency. In some counties, you may need to apply online in order to get a license.', 'If you intend to remarry after the marriage, the county where you got married will have the updated marriage license. You can apply and have a marriage license issued for the county where you reside.', 'Mail the application form to the court clerk in your county. Ask him or her to stamp the envelope.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}