{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0da039a-35f0-5641-8f35-5a10679c5803","task_key":"default--validation--32630","task_revision_id":"1","upstream_id":"32630","short_description":"HellaSwag validation 32630","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to formula feed a premature baby [title] Bond with your baby. [step] When your baby is being fed with tubes, you might find it difficult to connect with her. Talk to your nurses about doing kangaroo care, which helps you bond with your baby.\",\"endings\":\"['With this technique, you hold your unclothed baby (wearing a diaper) against your naked chest. One option is to wear a baggy button down shirt.', 'The cuddling and feeding is especially rewarding for your baby. [substeps] Cuddle with your baby during a nap.', 'If your baby is feeding from tubes, you can give her alternative foods as needed. [substeps] Spread the love among your nursing mother and baby.', 'They might also be able to start giving you healthy meals and treats. [substeps] If your baby cries with constant nursing, she might be fed too quickly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}