{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b019bba6-49e5-5930-a7ab-be48b4709a27","task_key":"default--validation--32502","task_revision_id":"1","upstream_id":"32502","short_description":"HellaSwag validation 32502","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prevent bed wetting [title] Realize that bedwetting is normal. [step] Although it may be inconvenient for you and embarrassing for your child, bedwetting is normal behavior in children. You can rest easy knowing that in many cases bedwetting will come to an end as your child grows older.\",\"endings\":\"['Until then you can patiently and calmly work with with your child until she has outgrown the ages most commonly associated with bedwetting. [substeps] Bedwetting is common in children of up to around five years of age.', 'In fact, bedwetting every two to three months is normal. [title] Talk to your child if they are having trouble sleeping.', \\\"But when your children are older, you'll experience a more nasty stop to bedwetting. [substeps] Another reason bedwetting is normal is because a child ages.\\\", \\\"[substeps] Make sure that you understand how to accept bedwetting as an inevitable part of your child's development, and identify the possible consequences. Bedwetting will actually be a lifelong point of your child's development.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}