{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc551b08-0b0a-5d95-84b3-b4c6bd4f42a9","task_key":"default--validation--7289","task_revision_id":"1","upstream_id":"7289","short_description":"HellaSwag validation 7289","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to get an exercise wheel for your cat [title] Shop around for sales and deals. [step] Cat wheels can be a great way to prevent feline obesity and boredom. However, they generally cost between three and nine hundred dollars (us).\",\"endings\":\"['It is important to find sellers that accept more than $100 , 000 to give you a refund. [substeps] There are also wide variety of brands and prices that will allow you to check around and see which ones would be ideal for your cat.', 'You will need to have a good warranty, meaning you will not need a wheel capable of rotating one wheel around the other. Check your local pet store or big box store to see if a pawn shop is offering you the money to get an exercise wheel.', \\\"If you see a product in a pet store, look online to see if it's cheaper to order it directly from the manufacturer. [substeps] Keep an eye out for sales at your local pet stores.\\\", \\\"Also, don't be afraid to go smaller your vet or animal shelter items first. Your vet will definitely be able to work with a specific brand of cat exercise wheel.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}