{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef67df2c-5114-5d6b-95cc-40c149ce8820","task_key":"default--validation--43269","task_revision_id":"1","upstream_id":"43269","short_description":"HellaSwag validation 43269","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to buy jicama [title] Find a store near you that sells jicama. [step] Jicama is becoming more common in both american and world cuisine, and as such it has become relatively easy to find. Many grocery stores will carry jicama in the produce section, especially between fall and spring when it is in season.\",\"endings\":\"['However, in cooler weather, this outlet may be more expensive. If you will be hunting outdoors, shop online so that you will know exactly how much jicama you will need.', 'Jicama is particularly common in southern regions, as fruit stores and restaurants quickly supply many from this region. [substeps] Jicama is also present in mexican and asian countries, such as mexico, bahrain, argentina, and africa.', 'Visit american grocery stores to request a variety of jicama. [title] Determine how much jicama you want to purchase.', \\\"If you can't find it at a regular grocery store, try an organic foods store or a farmer's market. Specialty mexican grocery stores may also carry jicama.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}