{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67c54271-aa4f-5de2-9075-95e89f597c50","task_key":"default--validation--44247","task_revision_id":"1","upstream_id":"44247","short_description":"HellaSwag validation 44247","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to safely use all natural skincare products [title] Find high-quality ingredients. [step] Search for retailers that specialize in the items you're looking for. You're more likely to get a purer product.\",\"endings\":\"['Make sure you\\\\'re buying the right ingredients for your skin type. [substeps] Ask what the generic name for \\\" natural skincare products \\\" stands for.', \\\"For example, if you're looking for essential oils, contact a company that primarily produces essential oils. Always read labels which should tell you the name of the product, where it came from, how it was produced, when it expires, and whether it's organic or certified.\\\", 'Look for products that contain nutritional and health enhancement, which can help your acne. [substeps] Try to purchase products from a brand marketed specifically for skincare.', \\\"Similarly, you'll buy products with high levels of oil and other ingredients. Ingredients containing natural ingredients will help keep your skin soft and unclogged.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}