{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0945aca-f7ba-59b0-9ebd-a67473fc4d07","task_key":"default--validation--3353","task_revision_id":"1","upstream_id":"3353","short_description":"HellaSwag validation 3353","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to modify a prenuptial agreement [title] Go over the agreement with your spouse. [step] Review each provision in your prenuptial agreement to decide which provisions you and your spouse want to modify. [substeps] A prenuptial or postnuptial agreement is only valid after full disclosure from both you and your spouse regarding your income, assets, debts, and liabilities.\",\"endings\":\"[\\\"If any of this information has changed since you signed the prenup, share it openly. Don't assume that your spouse knows.\\\", '[title] Read and review the prenuptial agreement. [step] Include any clauses or provisions which you or your spouse agree to modify.', \\\"[title] Obtain a copy of the prenuptial agreement. [step] Once you've reviewed all of the provisions in the agreement, you'll want to make sure you have an exact copy of the prenuptial agreement.\\\", 'With postnuptial agreements, you are legally bound by the terms you satisfy with the other spouse. [title] Draft the proposed or modified prenuptial agreement.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}