{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7510aafc-4514-525d-a606-ebcd5f88eec8","task_key":"default--validation--33731","task_revision_id":"1","upstream_id":"33731","short_description":"HellaSwag validation 33731","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to calculate dog years [title] Learn your dog's age in actual years. [step] Knowing your dog's actual biological age is necessary to calculate his age in dog years. It also helps you make decisions during his life that are usually based on age, such as when to spay or neuter and when to change to a senior diet.\",\"endings\":\"['[title] Determine how old the dog is when deciding to breed. [step] Newborn puppies must be at least a year old.', \\\"[substeps] Finding out your dog's age is easy to do if you have the dog's records or got him when he was a puppy. However, if you don't have this information readily available, there are other ways to determine his age.\\\", '[substeps] Another important aspect of calculating dog years is looking at a dense reproductive tract (a vulva). The vulva is the part of the brain that processes hormonal hormones.', \\\"This will give you a better idea of your dog's age. [substeps] Step 10 of the maclozone is a dog age calculator you can download at https: // www.hudd.net/finance/organizations/actions /.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}