{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4fcacf7-c27e-5522-ae6f-81391882cf3e","task_key":"default--validation--7435","task_revision_id":"1","upstream_id":"7435","short_description":"HellaSwag validation 7435","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to have a healthy second marriage if you were widowed [title] Have an open conversation with your new partner. [step] Remarrying doesn't mean forgetting. Falling in love with someone after your spouse dies doesn't mean that you've forgotten your spouse or have entirely moved on.\",\"endings\":\"['[title] Ask about friends, familial connections, family activities and other pertinent factors. [step] If you are not sure you have gotten along with your new partner, ask him or her how the kids are doing.', \\\"All it means is that you've fallen in love with someone else. You'll likely still think of your former spouse and miss them, and that's perfectly normal.\\\", \\\"That's because most divorce happens to couples who aren't close to each other. [substeps] When you hear that your spouse has died, your first instinct may be to grieve or regret your loss.\\\", \\\"Instead, you're dropping love as it's replaced by fun and someone new. [substeps] You may be very sad that you lost your partner, but doing this will help you reaffirm the marriage and your love for her again.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}