{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9dd2fa98-6543-536b-93b7-125b00458953","task_key":"default--validation--48516","task_revision_id":"1","upstream_id":"48516","short_description":"HellaSwag validation 48516","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to read a book to a baby or infant [title] Read at a slow pace. [step] As you read, make sure to go slow. In addition, enunciate words carefully and correctly.\",\"endings\":\"['This ensures that the book tells a complete story. [substeps] Avoid over-stressing the child.', \\\"The more you slow down, the more likely the child will be to guess what you're reading. [substeps] Read at any fast pace you have.\\\", 'This way, your child-depending on age-can better follow along. In addition, reading slowly will make your time together more relaxed and enjoyable for both of you.', 'Your baby may think, \\\" whoa, yeah, now you don\\\\'t understand, \\\" or \\\" wow! This is so fast! \\\" this is because you are planning to read it before you leave the library. [substeps] If your baby gets fussy, they\\\\'re probably hungry.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}