{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56925c9d-3420-5829-92bf-703e89d19f79","task_key":"default--validation--33307","task_revision_id":"1","upstream_id":"33307","short_description":"HellaSwag validation 33307","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to cure lipomas naturally [title] Create an ointment using natural oils and herbs. [step] Natural oils such as neem and flaxseed make excellent base for ointments. Experiment with different combinations of herbs and oils.\",\"endings\":\"['Some suggestions for salve commonly used to treat lipomas are : [substeps] Grapeseed oil tea tree oil, which can become more active by adding lemon essential oil [title] Keep your mouth moist. [step] Sweet cranberries, garlic, and eucalyptus oil can irritate your mouth and cause swelling in the tissues.', '[substeps] Cypress, argan, jasmine, rosemary, watercress, chamomile, fennel, bamboo, thyme, and ginger all help with good elasticity. Calendula, perennial avocado, mint and coriander all make excellent skin.', 'You can use olive oil, jojoba oil, oregano oil, and argan oil to help provide an oil-free solution to your sunburn. You can also try adding herbs to a regular moisturizer and cover with a layer of lotion or lip balm to keep the sun out.', '[substeps] Neem oil is an astringent that helps protect your skin. It is commonly used in ayurvedic (ancient indian) medicine to treat lipomas.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}