{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fa5581e6-4434-5b5e-9232-3e0a9b15b95f","task_key":"default--validation--29622","task_revision_id":"1","upstream_id":"29622","short_description":"HellaSwag validation 29622","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to act when you dislike your teen's date [title] Talk in private. [step] Pointing out your distaste for your child's date when they are around can be a recipe for disaster. What's more, saying \\\" i don't like him/her \\\" in someone's face is just plain rude.\",\"endings\":\"['When you talk about your prejudice, look your child in the eye. Nod your head and give them a single \\\" i \\\" or two in return to show that you appreciate what they have to say, and to make sure you agree with them.', \\\"Even worse, you could be telling your teen they are going to this particular party but their date isn't invited. Wait until your teen has other plans and has lots of time to pack their bags.\\\", \\\"Showing fear, distrust and judgement will only create more tension in the classroom and cause more of a fight between your teen and his date. [substeps] Think rationally about what to say and what you'd say if your teen becomes a distraction.\\\", 'Your child is more likely to consider your point of view if you pull them aside and have the conversation in private. Also, be sure to do this early on, and not spring this on your child at an awkward moment like right before they head out to prom.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}