{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"441c6145-05da-50c9-bc77-f51ed4e5fad7","task_key":"default--validation--3856","task_revision_id":"1","upstream_id":"3856","short_description":"HellaSwag validation 3856","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to develop your baby's brain [title] Shower your baby with affection. [step] What babies need most is love and attention. A baby needs to know they are safe, secure, and loved for their brain to develop properly.\",\"endings\":\"['[substeps] If you shower your baby with love and affection, it makes babies feel safe, secure, and loved. It also checks for changes in their actions and how they think and feel.', 'Showering your baby with affection is a good way to reassure and also entertain the baby so they can become independent. [substeps] Avoid putting your baby on a diet or rough feeding with them.', 'When your baby cries, pick them up to see if anything wrong. Even when your baby is not crying, engage with your baby all throughout the day.', \\\"Without physical affection and emotional affection, a baby's brain is liable to tear down into pieces that are difficult to digest. You can prepare your baby for most tasks using a washcloth and warm water.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}