{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc577338-411c-5665-956b-e6a7ebf968dd","task_key":"default--validation--41674","task_revision_id":"1","upstream_id":"41674","short_description":"HellaSwag validation 41674","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to get over a cheating boyfriend [title] Own your pain. [step] Being in denial about what you're feeling will only draw out the healing process. Betrayal is painful, so give yourself permission to mourn however you need to.\",\"endings\":\"[\\\"It's ok to grieve, but simply do not let your hurt come out and make it tough. Doing so will only sap your joy from your relationship and only more sadness will come.\\\", 'Unfortunately, acknowledging how you are feeling can be the only way to begin healing. It is impossible to suppress your feelings in the moment.', 'Holding yourself to absolution will only make what happened worse. [substeps] Changing your habit of ignoring painful things is one thing, but suffering through a cheating partner can do damage to you emotionally.', \\\"[substeps] Curl up in bed for a day or so. Cry your eyes out until you can't cry anymore.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}