{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"728b6784-fa6d-56b7-8da8-0bccfc0ee96c","task_key":"default--validation--15927--variant-2a9f3042b065","task_revision_id":"1","upstream_id":"15927--variant-2a9f3042b065","short_description":"HellaSwag validation 15927","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to introduce a boyfriend to children [title] Wait to introduce your boyfriend to your children. [step] After you've been dating your boyfriend for about six months and see this as a more exclusive relationship, consider introducing him to your kids. But nonetheless, talking about your children with your boyfriend early will help to set the tone for when he does meet them.\",\"endings\":\"['[substeps] Naturally during this time, your dialogue with your child should vary according to their age (this will be discussed later in the article). Avoid introducing him too soon to your kids.', 'If your boyfriend was going out of his way to introduce your new boyfriend to the kids, and a young man does not absolutely need to meet his kids before he even gets to know them, this is a bad sign. [title] Come clean with your husband about your intent.', '[title] Tell them that you are not dating until the kids are \\\" teenagers. [step] \\\" let them know that this is the first time you have met your boyfriend.', \\\"[substeps] If your children are young and you child is between the ages of 2 and 4, introduce them to the father from your previous relationship. At this point, it is realistic to assume that there is a high likelihood that they'll have similar families as their parents.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}