{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f6af03c-c184-54b1-abbb-682e8b9710d7","task_key":"default--validation--2864","task_revision_id":"1","upstream_id":"2864","short_description":"HellaSwag validation 2864","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to avoid raising a bully [title] Talk to your child. [step] Be interested in your child's life, and check in with them on a regular basis. Ask questions like what they're working on in school, how their friends are, and what's been getting under their skin lately.\",\"endings\":\"[\\\"Ask about their health, and address concerns you may have about what type of bullying they might be dealing with. [title] Watch for signs of the bully's behavior.\\\", \\\"[substeps] Give your child your full attention when you talk with them. Kids know when you're tuning them out or just pretending to be interested.\\\", \\\"You'll also make sure to inquire about their interests, and try to bring up the things they did well in school. [substeps] It might be helpful for you to ask them questions at school about sports, if anything, while you don't want to come across as a bully.\\\", \\\"Basically, make a list of all the events, clothes they've worn, or other activities they enjoy the most. [substeps] Always be observant, and take up as much time as possible to learn about your child's life.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}