{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25085a9d-37d7-5a9c-8cd1-d131ed813110","task_key":"default--validation--13274","task_revision_id":"1","upstream_id":"13274","short_description":"HellaSwag validation 13274","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to keep a pacifier from falling out of a crib [title] Install mesh netting inside the crib to create a bumper. [step] There are many different types of mesh crib liners you can buy to keep pacifiers and other things inside of the crib. These mesh liners serve as a type of bumper and are very easily installed.\",\"endings\":\"['Mesh netting is easier to install, so will help to protect your crib from falls or next year baby cribs. , or make it even more interesting by purchasing mesh netting that matches your crib.', \\\"They come in a variety of different colors and patterns from several different companies. Simply position the lining against the walls of the crib and tie the ends to the crib's bars.\\\", 'Rods will catch the material in the window and keep it in place, keeping the toy inside and out of the way. You can also use a piece of wood or mesh cloth so that you can install the cage on top of it.', \\\"Be sure to check the seller's recommendations before purchasing a blanket or mattress liner. [substeps] Mesh nets are typically included with your crib to prevent the baby from using this kind of crib.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}