{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"86a7c265-fe24-5242-a6d1-3ed3f7b87cf2","task_key":"default--validation--20474","task_revision_id":"1","upstream_id":"20474","short_description":"HellaSwag validation 20474","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to beat the pink tax [title] Read labels carefully. [step] Before making a purchase, scrutinize the label. This can help you identify the pink tax.\",\"endings\":\"[\\\"You may think certain products are marked up fairly, because they contain different ingredients or come in greater amounts. However, you may find many women's products are similar to men's products but needlessly marked up.\\\", 'In particular, watch out for words and abbreviations which indicate a high quality product and rich background. Looking for this information can be a good indicator of whether or not the individual or business should buy this product.', 'Make sure it states in red letters exactly how many days the policies have expired. [title] Do not buy products or companies that claim to be pink tax-free.', 'This knowledge will help you be able to analyze the products you buy and plan those purchases accordingly. Here are some of the known labels that can help you locate pink tax : [substeps] Lampshades summer coats winter coats rain gear clothes clothing [title] Realize the differences between these labels.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}