{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be9f04ba-be80-57bf-abeb-33f415c0c22c","task_key":"default--validation--14487","task_revision_id":"1","upstream_id":"14487","short_description":"HellaSwag validation 14487","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prove adultery [title] Determine why you want to prove adultery. [step] Before the advent of \\\" no fault \\\" divorce, proving adultery was one of the few grounds on which a divorce could be granted. Today, however, couples can simply claim irreconcilable differences and be divorced.\",\"endings\":\"['Different reasons for wanting to be married depend on where your marriage took place. [substeps] Domestic violence: if you and your partner had a relationship that lasted over two years, you can prove adultery by fighting how long you had meant to stay apart or not spending at all.', \\\"[substeps] For example, if you are married with children, you might say that you wanted adultery because your spouse had stopped living in the home and no children were born. You could claim that you wanted adultery because you're the father of a child and did not expect your children to be born on time.\\\", 'Nevertheless, some states allow people to file for divorce immediately if they can prove adultery. If they claim irreconcilable differences, then they may have to wait a period of time (such as six months).', 'This is why, if not proven, \\\" nothing \\\" such as adultery isn\\\\'t considered a fault. As such, you must consider whether you want to have your divorce made invalid, or how often you intend to continue the marriage to win.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}