{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5977d51-f8e2-52cb-afe6-fccbc9a08454","task_key":"default--validation--31981","task_revision_id":"1","upstream_id":"31981","short_description":"HellaSwag validation 31981","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be less needy with your spouse [title] Build self-worth. [step] Perhaps the most important step in becoming less needy with your spouse is becoming more confident in yourself. In practicing these exercises, you may realize that although you love your spouse, you don't have to spend every waking moment with them, and that it's natural to want to do things on your own.\",\"endings\":\"[\\\"Self-confidence is actually pretty common, and is an important asset for having a healthy, happy marriage. [title] See your husband's side of the story.\\\", \\\"Just make sure that what you do doesn't end up hurting you or causing you stress. [substeps] Incorporate the confidence you feel into everyday activities.\\\", '[substeps] Work on self-love to boost your self-confidence. Identify the qualities you like about yourself and that you are proud of.', 'Instead, try to own your own goals and in turn try to share them with your spouse. [substeps] At first, start by eliminating the need to talk, go to the sink, eat lunch, or go to bed.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}