{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25c6c585-0b0f-572a-8d91-b2c9fcf5b145","task_key":"default--validation--20199","task_revision_id":"1","upstream_id":"20199","short_description":"HellaSwag validation 20199","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to fight feelings of failure as a mother [title] Acknowledge that you are human. [step] If you tend to criticize yourself often for mistakes you have made, then it may help you to consider that everyone makes mistakes. It is just part of being human.\",\"endings\":\"['We all make mistakes in our life, and you have to accept that your shortcomings are not the only ones that you are disappointed in. No one knows who is right and who is wrong.', '[substeps] Try telling yourself something like, \\\" i am human and sometimes i make mistakes, but that is okay. I can make some mistakes and still be a good mother.', 'It is not about dwelling on past or future failures: it is about learning to recognize the flaws in yourself. [substeps] Some people may say, \\\" my mistake was something that i couldn\\\\'t control.', 'Acknowledging and appreciating your faults can help you stay human, regardless of how you think you make them. [substeps] What you say to yourself in the morning or at night may not be completely the same as what you say to yourself in the morning.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}