{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ac93456-84bf-5c06-9bbb-60f8c31bab27","task_key":"default--validation--15659","task_revision_id":"1","upstream_id":"15659","short_description":"HellaSwag validation 15659","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be happily married [title] Don't expect your happiness to be derived from someone else. [step] The most common mistake made in the quest for a happy marriage is to expect that someone should be \\\" making \\\" you happy. The old saying \\\" to have friends requires one to be a friend \\\" applies.\",\"endings\":\"[\\\"Regardless of whether your happiness is due in some sense to someone you love or something to do with your own, you should hear and be happy. [substeps] Two people don't get married just because there is someone else there to provide love and companionship.\\\", 'Refrain from assuming that your friends and family love and care for you. In fact, expectations for your happiness are far from accurate.', 'If someone is what you expect them to be, try to be a \\\" friend \\\" with them. They will likely be incredibly happy when they express their true love, and please, observe them for a moment before delving in deeper.', '[title] Focus on how you can make the marriage happy. [step] The only way you can be happy is by focusing on your own efforts to make your marriage partner happy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}