{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bf004497-1b68-5fd0-85ba-8bbc3cbb2cfd","task_key":"default--validation--41055","task_revision_id":"1","upstream_id":"41055","short_description":"HellaSwag validation 41055","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to pay a pet sitter [title] Determine the going rate for pet sitters in your area. [step] Before you decide what to pay a pet sitter, you should determine the pay rates in your area. You do not want to mistakenly offer your sitter too much or too little for the job.\",\"endings\":\"['Find out and ask your local animal shelters what their rates are before you make your selection. [substeps] You can also check with online services such as petfinder.', '[substeps] Browse the yelp pages in your area for pet sitting companies and individual pet sitters. Find a link to their website from there and see what rates they typically charge.', 'In addition, simply tracking down the average pay rate for pet sitters could lead to lower costs if the sitter uses part time or on-the-job budgets. [substeps] Look through local pet sitter associations like yamano or caputt, and compare rates.', 'However, you should assess what you understand about the job before deciding what payment methods you want to use. [substeps] Check with your vet for the pay rate in your region.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}