{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"730f61ae-c48f-512b-879c-b4828ec6e705","task_key":"default--validation--9892","task_revision_id":"1","upstream_id":"9892","short_description":"HellaSwag validation 9892","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get a domestic partnership [title] Determine if you able to get a domestic partnership. [step] The laws regarding domestic partnerships are different in various locations. Because domestic partnerships are not uniformly created, it is challenging to locate the statutes.\",\"endings\":\"['Some states let domestic partnerships coexist under mandated statutes. Other states allow domestic partnerships to be dissolved in common situations such as divorce, child custody, or annulment.', '[substeps] If you live in a quiet area, you may be able to establish the rules with a few simple emails and letters. If you live in a more public area, you may be able to establish non-public partnerships by cashing-in accounts with friends and family.', 'Some examples of domestic partnerships include : [substeps] Owners of sole proprietorships income of one of a minority joint owner of the full proprietorship or bank accounts that are endorsed or subsidized by the full spouse. Agencies such as sole proprietorships or mortgages state that owners must meet certain requirement parameters to get a domestic partnership.', 'Start with the state statutes and search for domestic partnerships. If you find nothing, look at codes for your local county/parish and city, again, searching for domestic partnerships.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}