{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74c91648-7e43-5a0d-bee8-59262dbb1726","task_key":"default--validation--10309","task_revision_id":"1","upstream_id":"10309","short_description":"HellaSwag validation 10309","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to open yourself to love again after divorce [title] Get positive. [step] You may have felt hopeless or in despair in your marriage. Don't let that mindset carry over to how you feel now.\",\"endings\":\"[\\\"You have the opportunity to create a different dynamic with someone, so go for it. If you felt like you couldn't talk to your ex-spouse, commit to communicating more effectively now.\\\", 'Return to focusing on what might have been, and use that feeling to walk away from the difficult things. You can say, \\\" my life was so miserable then because i would have tried something completely different.', \\\"Focus on the positive aspects of your life and think about the good aspects, like your happiness and having children. [substeps] Ask yourself how you wouldn't be feeling if things were reversed.\\\", 'While we all know you are sad in the present, we are here now because you need, not because of a dead end. Self-worth and integrity are the key parts to learning to love again.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}