{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc7d923c-9541-595d-be16-5b2d570abb7a","task_key":"default--validation--9806","task_revision_id":"1","upstream_id":"9806","short_description":"HellaSwag validation 9806","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to improve language learning in babies using music [title] Add gestures that match the song. [step] Most babies develop the ability to control their fingers and hands (at around nine months) before they can control their speaking voice (somewhere around ten to twelve months). As anyone who uses sign language can tell you, communicating with gestures requires similar memorization and pattern recognition and anticipation skills.\",\"endings\":\"['Therefore, using music and gestures in combination can enhance the developmental benefits for your baby. [substeps] Try using simple songs that utilize simple hand gestures that coordinate with the lyrics.', 'Both sign language and memorization skills are key to successful language learning and screenwriting. [substeps] The key to a successful sign language learning are signing with your fingers, using sign language, and memorization skills.', \\\"If you know how to change the song it's not difficult if the song lyrics don't translate into the words correctly, watch how the typical italian song progresses. [title] Don't punish children for facial tics.\\\", \\\"It shouldn't take long for babies to understand a few key gestures, it just takes time. [substeps] Both sign language and hand language have to work together.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}