{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ff65b60-b304-5893-9116-d1e2a5293bce","task_key":"default--validation--23722","task_revision_id":"1","upstream_id":"23722","short_description":"HellaSwag validation 23722","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with divorce as a child [title] Express your feelings however you need to. [step] Coping with your parent's divorce brings up many feelings. It is perfectly normal to feel hurt, upset, angry, sad, or confused.\",\"endings\":\"['If your parent is divorcing you, the best thing you can do is express your feelings as they are. It can take time, but knowing how to cope can help you get through this grief.', 'When you are dealing with divorce you need to be available to your parents and your guardians whenever you need to share thoughts. When you are dealing with divorce you need to be available to them when you need to talk.', \\\"Express these feelings in a way you can be understood and supported by others. [substeps] If you don't feel comfortable talking about your emotions, seek professional help.\\\", 'Plus, these emotions may change from day to day. Everyone goes through a wide range of emotions during this time.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}