{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"454c6359-4cbe-587d-b8cc-5f5f9e588081","task_key":"default--validation--35456","task_revision_id":"1","upstream_id":"35456","short_description":"HellaSwag validation 35456","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with an existential crisis [title] Identify your crisis triggers by examining your recent actions and thoughts. [step] Think about someone who you admire, even if you've never met them. Then, envision telling them how you are feeling and what they'd say in response.\",\"endings\":\"['Think about how you have reacted to these scenarios. [substeps] For example, if someone you admire tells you, \\\" i really like him, but his act of kindness is not appropriate for everyday interaction.', 'This will help you to feel more in control. Reading your thoughts aloud can also help to sort them and reframe them to introduce things about you and the past.', 'Worry a lot over how you felt, what your response would be, and so forth. [substeps] During this time, find some concrete solutions and ways you can relax and cope.', \\\"This is a great way to give yourself advice, but in a more detached sense. [substeps] For example, you might express your concerns to imaginary oprah winfrey and guess what she'd tell you to do.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}