{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df83e06b-bcdd-5613-8eb2-2a1476c8e1a6","task_key":"default--validation--12772","task_revision_id":"1","upstream_id":"12772","short_description":"HellaSwag validation 12772","config":"default","split":"validation","body":"{\"activity_label\":\"Cars & Other Vehicles\",\"ctx\":\"[header] How to save money on motorcycle trailer rentals [title] Shop around. [step] If you want to find a good price, you'll need to shop around. Spend some time familiarizing yourself with rates and pricing from different rental companies.\",\"endings\":\"['You can look at their website, but most importantly, look through their flyers, radio ads, catalog, and sales pitch. [substeps] Buy motorcycle trailers from a reputable dealership if possible.', 'Look around the lots to see if people often pick single trailers to rent. Consider checking reviews in various classifieds websites like craigslist or multitasking.', 'Get inspiration from shop guides on the internet to help you find better options that the major dealers in your area possess. [title] Determine the price you want to charge.', \\\"[substeps] Major national companies, like uhaul, may be a good place to start if you've never rented a trailer before. This can give you a sense of what bigger companies typically charge for rentals.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}