{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69f0f943-169f-59d6-97c2-d9195110d588","task_key":"default--validation--37689","task_revision_id":"1","upstream_id":"37689","short_description":"HellaSwag validation 37689","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to act if your child has started saying bad words [title] Don't overreact when you hear bad words from your child. [step] Sure, it's not what you want to hear, but the situation isn't doomed. You haven't raised an uncouth monster; there are many avenues through which your child might have been exposed to swearing.\",\"endings\":\"[\\\"Avoid yelling, screaming, chewing gum, and locking doors right out in the open: this can escalate the situation rather than make a huge difference in your child's day. [title] Wait for the urge to curse before speaking.\\\", \\\"Many would say that not all swearing is bad, but you need to help your child learn what language is appropriate in what settings. This can take some time, but they'll get there.\\\", \\\"Don't expect your child to be instantaneously fluent in a couple words. Instead, give yourself a day or two to adjust your expectations and reactions.\\\", 'In order to listen well you must be present. Say one, make two, and decide who says the bad thing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}