{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b5f1f55-b3f7-5aab-aee9-716f10e44bdf","task_key":"default--validation--24580","task_revision_id":"1","upstream_id":"24580","short_description":"HellaSwag validation 24580","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to ease stress with essential oils [title] Use only high quality essential oils. [step] One hundred percent organic essential oils are always the best option when purchasing essential oils. Aside from the environmental benefits of buying organic products, this will also ensure that you're getting an oil that came exclusively from a plant, without added artificial ingredients.\",\"endings\":\"['[substeps] Home and garden or garden shops produce good organic oils. Location, yield, and quality of essential oils is of major importance to you, or where you live.', '[substeps] Ornamental (non-organic) oils are almost always the best option. They contain a natural moisturizing effect, and will normally make their bottles any shade of green, without having to be washed.', '[substeps] You will notice a price difference between 100% organic oils and those that contain synthetic chemicals. While organic options will be more expensive, the cheaper options are potentially dangerous to inhale.', 'If you are not satisfied with your product, do not buy it. It may seem like a good idea to purchase fresh essential oils, but if you are bored, these are usually not ideal for your health.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}