{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a0595868-3f93-58de-8e69-be093156fe12","task_key":"default--validation--37099","task_revision_id":"1","upstream_id":"37099","short_description":"HellaSwag validation 37099","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to prepare your old english sheepdog for a show [title] Always find a reputable breeder. [step] Look around to find a breeder. The best places to spot one are in dog fancy classifieds, dog world classifieds, akc gazette, or www.akc.org where you can find the breeder classifieds.\",\"endings\":\"[\\\"[substeps] Check breeders' websites such as the' dog searching book for'. Browse old american newspapers and magazines to ensure that there are no shortage of reputable breeders.\\\", 'You can also call local dog shops and see what they have to offer and how much they would charge for a pup. The frequency at which many parents will advertise their offerings may also let you find a breeder who is reputable.', 'Be prepared to pay a certain number of dollars for an old english sheepdog with good records and strong personality. [title] Ask your veterinarian about your old english sheepdog.', \\\"Also, a great place to spot your breeder is at your local kennel club's dog show. Internet listings are not the best, as many of the dogs come from puppy mills.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}