{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd58b972-7249-5048-b766-bc65f54f4860","task_key":"default--validation--10252","task_revision_id":"1","upstream_id":"10252","short_description":"HellaSwag validation 10252","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to maximize your baby's alert time [title] Wait for a quiet alert time. [step] Quiet alert time usually comes right after your baby has just woken up. While the baby may move their arms or legs, they are mostly quiet.\",\"endings\":\"[\\\"They do not display any signs of alertness until they've opened their eyes. [substeps] Mild to moderate alert time may be indicated by just your baby's head facing the ceiling.\\\", \\\"Seek out their body language and especially monitor their mouth. This can help guide your decisions regarding when it's appropriate to alert your baby and what to do at a moment's notice.\\\", \\\"You don't need to wait for a loud alert time. [substeps] You can download an alert time app on a smartphone or tablet and use it in order to get alerts as soon as your baby comes out of the womb.\\\", 'They may be looking at your face or responding to sounds. This state usually lasts for about an hour at a time, but you may be able to extend it through contact with your baby.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}