{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e818fddc-9550-50cf-aab5-0ffb30f97c40","task_key":"default--validation--19726","task_revision_id":"1","upstream_id":"19726","short_description":"HellaSwag validation 19726","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to bond with your newborn when you have postpartum depression [title] Talk to your baby. [step] One good way to bond with your baby is through verbal communication. Babies learn and respond to your voice.\",\"endings\":\"['This means that you should talk to your baby throughout the day. It can be any type of communication you feel comfortable doing as long as you are looking at your baby and using your voice.', 'Try talking about your feelings as well, whether you share the excitement, excitement, or worry about something. [substeps] If you are struggling to talk to your baby or have come across as sad, hard-to-get, or unwell, try practicing \\\" baby talk \\\" together.', 'Often, this means that they will be interested in the way you say phrases when your baby is in and out of your arms or in the waiting room. To converse with your newborn, you will need to make an effort to give your baby a diverse range of words and phrases.', 'If you use an unaccompanied voice, they may not know what you\\\\'re saying. Ask your baby, \\\" do you hear me? \\\" when you speak in a calm, low voice, your baby will absorb how you sound rather than hear your voice.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}