{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6139e969-8c55-5259-986c-f58bd962c2cb","task_key":"default--validation--36798","task_revision_id":"1","upstream_id":"36798","short_description":"HellaSwag validation 36798","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prepare for a new baby [title] Recognize that fear is normal. [step] A new baby can bring a lot of fear and uncertainty because they are so small and appear fragile. You may ask yourself questions like \\\" am i up to this? \\\" or \\\" will i hurt my baby? \\\" and it's important to realize that these are very normal feelings.\",\"endings\":\"[\\\"If you know that you are anxious or angry, think about what is happening and now is the time for preparation. [title] Look at the baby's size and shaped shape.\\\", \\\"[substeps] Physical fear happens when your body adapts by becoming tense or ready for pain or inactivity and when the baby changes. You don't have to fear such a fear immediately, it just must be recognized in its positive or negative reactions.\\\", \\\"[substeps] Remember that there is no instruction manual for parenting and you'll figure things out as you go. Ask your family members, friends, and doctor any questions you have about preparing for your baby.\\\", '[title] End the stressful experience with feedback. [step] It will be easier for you to accept the baby from the hip section, where you can talk to the baby head-on.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}