{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"29bd91ad-bc18-53b5-b15b-d7cf5550f3cb","task_key":"default--validation--33767","task_revision_id":"1","upstream_id":"33767","short_description":"HellaSwag validation 33767","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to know if you should buy the extended warranty [title] Look at what is already covered in the warranty. [step] Start by reading over the warranty that already comes with the product, often for free. Most free warranties last for 12 months or one year.\",\"endings\":\"['An extended warranty will satisfy the following, however. [substeps] The first side for the trade life, the service life.', 'Look at the sticker and other features that are attached to the warranty; they should be listed because they have already been extended. If the manufacturer says these are covered in the warranty, you should take advantage of them if you can.', \\\"They usually cover normal wear and tear and the maintenance of the product based on the manufacturer's guidelines. This could include cleaning and maintaining the product as well as replacing damaged parts.\\\", \\\"Read and compare the product's expiration date and its parts you are already buying. If the expiration date is known, it's less likely that you need the proposed extended warranty.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}