{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"644f1471-2bff-580a-bd4b-5412675b65f3","task_key":"default--validation--34292","task_revision_id":"1","upstream_id":"34292","short_description":"HellaSwag validation 34292","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to avoid toxic personal care products during pregnancy [title] Stay away from parabens. [step] Parabens may disturb your endocrine system. Because of this, it is important to make sure that the products you use do not contain parabens.\",\"endings\":\"['The bloat result is associated with decrease in vibrational cells than the formation of bellystones. Do not open the vagina itself, as doing so can irritate the skin.', 'The result of an alpha-factor biochemical reaction occurs during the implantation process. [substeps] Large amounts of parabens are found in computer products.', 'Unfortunately, parabens are found in 75-90% of all personal care products-from face powder to eyeshadow. [substeps] Read the labels on your personal care products before you purchase them.', 'However, for customers, just because the products are marked as acceptable does not necessarily mean that you must no longer use them. [substeps] If you are using water or laundry detergent, be aware that many practices are unsafe for those pregnant with pms.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}