{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c947708-c3a2-5e04-8991-354072e14755","task_key":"default--validation--34203","task_revision_id":"1","upstream_id":"34203","short_description":"HellaSwag validation 34203","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to bond with an aloof dog [title] Play with your dog. [step] A good way to build a bond with an aloof dog is to play with them. Dogs love to run, chase, and chew.\",\"endings\":\"[\\\"Simple things like keeping your dog's teeth between your fingers and playing fetch will help him to feel comfortable having company while you play. [substeps] Plan on using toys specifically designed for dogs.\\\", \\\"Incorporate these things into your interactions with your dog. You may have to coax them into playing because they're aloof, but keep working at it until the dog comes around.\\\", \\\"If you notice an aloof dog playing with you, approach the dog with a' hi' and let them play together. In your own home, you should take the dog out for walks, socialize their owner, or just chat with them.\\\", 'You can take your cool down with looking at them while playing with them. [substeps] You can simply play fetch with your dog while in the back yard.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}