{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"897017fb-40aa-5c76-9191-7036830724c1","task_key":"default--validation--50310","task_revision_id":"1","upstream_id":"50310","short_description":"HellaSwag validation 50310","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to care for your husband [title] Get your husband to open up. [step] Some men are socially conditioned to avoid talking about their feelings. This can be damaging to the relationship, as it leaves a lot of important feelings unexpressed.\",\"endings\":\"['If you can, make him open up to you. This will help your husband open up and appreciate you more fully.', \\\"Have him say what's on his mind in an upfront way. [substeps] Your husband cannot tell you everything, just open up to him.\\\", \\\"However, respecting your husband's feelings is vital for a successful marriage. Start making him open up to you on a regular basis.\\\", \\\"If your husband has a hard time opening up, you may need to work harder to learn how he feels and what he needs in the relationship. [substeps] Let your husband know that you'd like to know how he feels.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}