{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed71e640-b49a-54d5-9778-24dbbf314f1d","task_key":"default--validation--15241","task_revision_id":"1","upstream_id":"15241","short_description":"HellaSwag validation 15241","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to re ignite passion in a marriage [title] Understand how to create passion. [step] Passion is a phenomenon that is created. It is not a spontaneous thing that just happens.\",\"endings\":\"[\\\"Having passion is about the way you are physically and emotionally connected to your spouse, not the other way around. It's a mutually important part of a marriage, but the most important step in the marriage and life.\\\", 'Passion is created by both the parties, and is used to express feelings or goals. [substeps] The important fact of creating passion in the marriage is recognizing that you and your spouse share at least some of the same feelings.', 'It is an impulse that occurs every day, once something becomes necessary. The emotional energy that comes with passion is euphoric.', 'In order to understand how to create passion, you must do two things. First, you need to understand why you feel passion.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}