{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0db86660-b072-5b04-9faf-b52a92cad571","task_key":"default--validation--18372","task_revision_id":"1","upstream_id":"18372","short_description":"HellaSwag validation 18372","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to emotionally prepare for a funeral when you have depression [title] Accept your feelings. [step] Death brings out a wide range of emotions in people, especially when depression is added to the mix. You may feel numb, shocked, or unable to cry.\",\"endings\":\"['You might also feel too sad to function right now. Your feelings are normal, and there\\\\'s no \\\" wrong \\\" way to feel.', 'Begin feeling isolated and emotionless as you face the death. [substeps] Listen to your emotions and do what needs to be done to make your day better.', 'Even if you are full of sadness, accepting that you are depressed can help you process the loss. [substeps] Some things that people experience often seem terribly terrible, such as a loss of friends, love, or family.', 'These feelings usually do not last long, especially in people with depression. However, knowing what you feel on an emotional level will help you accept your feeling.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}