{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e12df612-1b25-54c2-9f79-40ff4b9d88fc","task_key":"default--validation--6613--variant-c2a31ecb8fa2","task_revision_id":"1","upstream_id":"6613--variant-c2a31ecb8fa2","short_description":"HellaSwag validation 6613","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to rear a nice child [title] Practice being gentle. [step] How you treat your bay at the very beginning of his life matters a lot and can have a lasting effect on his development and mental health. From the very start, concentrate on loving and being very gentle with your child.\",\"endings\":\"[\\\"Work your way up from listening to him when he's upset or crying, and stroking him gently when he's yelling or crying. Dogs can sense your love and that put them at ease later on when the big thing is about them.\\\", \\\"Don't use force, just use your touch with loving and non-aggressive direction. When you are speaking to him, make sure to talk slowly to ensure that no one can interfere.\\\", \\\"[substeps] Give your baby lots of love and physical affection. The soothing warmth from a parent's touch can instill positive feelings in your child and reduce distress.\\\", 'Work hard, never at his pace and avoid pushing him. [substeps] For example, instead of telling your bay, \\\" that\\\\'s a nice shirt here! \\\" simply say, \\\" sorry to push you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}