{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7e9fd38-0b13-5d92-bbfa-067d8a0dbaf1","task_key":"default--validation--37723","task_revision_id":"1","upstream_id":"37723","short_description":"HellaSwag validation 37723","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to ask for a trial separation [title] Prepare your spouse. [step] You don't want to blindside the person out of nowhere. Alerting your spouse that you want to have a discussion can help him or her mentally prepare for what's ahead, even if they're not aware of exactly what you're going to say.\",\"endings\":\"[\\\"It's important to let your spouse know that you'll consider keeping a discussion between you and the attorney in front of the judge, regardless of your spouse's relationship to the person. [substeps] It's beneficial for you both to discuss potential attorneys beforehand.\\\", '[substeps] Just tell your spouse that you want a trial separation from them. Let them know, rather than explaining that you want to wait until immediately after your spouse is admitted to the judicial system.', '[substeps] You could say, \\\" i\\\\'d like to discuss where our relationship is headed. Can we sit down and talk about it soon? \\\" that helps clue your partner into the fact that something\\\\'s up.', '[substeps] You may send your spouse advance notice of your plans to discuss separation. That way, you avoid a lengthy wait of a week.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}