{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f036388c-8c25-5e2b-8da1-e79ce0e77cad","task_key":"default--validation--28144","task_revision_id":"1","upstream_id":"28144","short_description":"HellaSwag validation 28144","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to know when your marriage is over [title] Spend time together. [step] You need to spend time with each other to make the marriage work. If you avoid each other and feel relieved when you aren't together, it could be a sign that you've completely disconnected from the marriage.\",\"endings\":\"[\\\"If you're always together, you're ready to forget the relationship is over. [title] Don't feel the need to bring up the past.\\\", '[substeps] Ask yourself how much time you spend with your spouse, then compare that to the amount of time you spend at work (excluding the time you must spend working), with friends, with family, or online. Evaluate the amount of time your spouse spends away, too.', 'However, even hours spent apart will give you an invaluable opportunity to reconnect and connect. If you are spending money together, try using to your advantage.', 'Talking, having fun, and spending time apart can also help to know that your marriage is over. [substeps] When scheduling times for time apart, use that time to find hobbies that you both enjoy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}