{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2483ec94-2878-5ad0-adf3-9873ac6eafa9","task_key":"default--validation--21917","task_revision_id":"1","upstream_id":"21917","short_description":"HellaSwag validation 21917","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to safely rough and tumble play with your baby [title] Choose a padded play area. [step] When you are playing with the baby, find a soft, cushioned, or padded area. If the baby accidentally slips or falls, they will land on the padded play area.\",\"endings\":\"[\\\"The padding will also help give you time to take your baby's clothes off. [substeps] Always wear gloves when handling the baby.\\\", 'If you are playing with a heavy child, a soft surface will work if the baby rolls over to you. For small-sized babies, sit down on the edge of the play area.', 'Padding will need to be available across the playing surface to prevent the baby from landing on hard surfaces. [substeps] Ensure the playing surface you choose is padded from the soft materials, like rubber or wood to avoid breakage or injury.', 'A couch, bed, or carpeted floor may be suitable. You can also roll out a tumble mat or lay down some pillows to provide extra protection.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}