{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"16a6a71b-0040-5b1c-8d25-b332309af4f8","task_key":"default--validation--28006","task_revision_id":"1","upstream_id":"28006","short_description":"HellaSwag validation 28006","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to respond after a kiss [title] Enjoy the moment slowly, without worrying about next steps. [step] A good kiss is a moment out of time, so savor it. Don't feel like you must immediately move forward or have something to do next.\",\"endings\":\"[\\\"Let your feelings shine through and let anyone who needs a hug and a kiss next to you know that you're still there for them. These may include your family, friends, co-workers, and coworkers.\\\", \\\"When your new partner initiates the kiss, don't interrupt or rush things-just watch. [substeps] You'll have good moments ahead of you if you're having trouble remaining in the moment.\\\", \\\"You just have to be present with the moment. You don't need to think about other people, your future, to embrace it.\\\", 'Just enjoy the kiss! More often than not, the two of you will naturally find something to talk about, do, or just keep on kissing--so let the moment just happen. [substeps] In general, the best advice is just to go slow.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}