{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cee7ec09-3951-56f3-87df-70f031e586e4","task_key":"default--validation--14644","task_revision_id":"1","upstream_id":"14644","short_description":"HellaSwag validation 14644","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to co parent with an ex [title] Learn to forgive. [step] You may have a lot of personal issues with your ex and your feelings remain valid, even after the relationship is over. However, now that you're separated, you need to take a pragmatic view that places your child above all else.\",\"endings\":\"[\\\"You love your child, and there's no desire to hurt your child. However, you may be tempted to place an obstacle in her path if she made the same choice again in the past.\\\", \\\"Learn to forgive your ex from their transgressions, even if they haven't apologized. [substeps] To thoroughly forgive them, you'll need to take a mental inventory of what makes you angry at your ex.\\\", 'Recognizing the struggles you share may force you to improve your relationship. Instead of taking actions to hurt your child, you must work to forgive your ex.', 'This can help you better understand the situation and be able to work on recovering the relationship after it has ended. [substeps] There are two types of forgiveness: good forgiveness and the bad forgiveness.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}