{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3fd0c645-324a-5533-a415-28d4e1374369","task_key":"default--validation--21327","task_revision_id":"1","upstream_id":"21327","short_description":"HellaSwag validation 21327","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to encourage your senior dog to play [title] Play games with treats. [step] One way to encourage your senior dog to play is by incorporating treats into the game. Most dogs are motivated by food and will happily play food related games.\",\"endings\":\"['Some of the easiest and most stimulating games that you can play with older dogs include foraging for food. These games will not only encourage your older dog to get up and moving, but they will also stimulate their brains allowing them to problem solve.', 'Choose a game and expect that your senior dog will soon start to play. [substeps] If your dog suddenly starts to play fetch, play other games with it like fetch or charades, where you will hold out treats for your dog as it plays, but then practice tug or tug.', 'This can also be a fun way to socialize your dog while providing some outdoor entertainment. [substeps] If the senior dog or the older dog makes a mess, try out a few homemade games to encourage them to play.', \\\"When you put together your dog's favorite toys, you should be sure to emphasize one at a time. For example, if your dog only has one toy, you may want to reward it with a treat every time the toy is a treat you place inside your dog's mouth or you feed it new kinds of treats.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}