{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d84a8844-35de-5f99-923f-ac53aa78037d","task_key":"default--validation--10123","task_revision_id":"1","upstream_id":"10123","short_description":"HellaSwag validation 10123","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with visitors after giving birth [title] Explore your feelings about visitors. [step] Chances are that you are just as excited to have your loved ones meet your new baby as they are. But unexpected complications can arise during labor and after that may make welcoming visitors more difficult.\",\"endings\":\"[\\\"Take some time to feel things out and find out what's going on in regards to your baby. [substeps] Even the tiniest hint about a visitor can be startling.\\\", \\\"Taking some time to consider whom you'd like to visit and how to deal with potentially difficult situations can help prevent awkward encounters after you give birth. [substeps] Make a list of people whom you'd like as visitors and those who can wait a bit.\\\", 'Try not to focus on your feelings of anxiety, stress, or worry over having multiple people visit your family. Instead, focus on your attention on how your baby handles visitors.', '[substeps] View the birth as a fun day. Visit your child with a sense of pleasure.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}