{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2dd917bd-41fd-571a-826e-8a7d2f61e6c2","task_key":"default--validation--43512","task_revision_id":"1","upstream_id":"43512","short_description":"HellaSwag validation 43512","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help kids feel loved [title] Tell them you love them. [step] This maybe seem obvious and redundant, but if you repeatedly tell a child you love them, it will become set in stone, and they will never forget it. Tell them you love them when they do something good, bad, interesting, funny, adorable, or just randomly.\",\"endings\":\"[\\\"Here's how to say that you love them when they get better. [substeps] Say hello when they ask for help.\\\", 'Try making words after each point, so kids know exactly what you are saying. [substeps] Try making creative jokes about their looks.', \\\"No time is a bad time to tell your child you love them. [substeps] Note: it's a good idea to tell the child you love them while scolding them, if you're mad, or if they're in trouble.\\\", \\\"Say you love them often, and that you're happy about whatever you do. The most important thing is that children see the positive side of things, rather than the negative side.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}