{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa9493d4-19f3-5ca0-b8c7-f3fccf6072d5","task_key":"default--validation--13237","task_revision_id":"1","upstream_id":"13237","short_description":"HellaSwag validation 13237","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to use aromatherapy for depression [title] Know what oils help with which symptoms. [substeps] Clary sage essential oil can help with anxiety, depression and insomnia. Basil works against depression, fatigue and anxiety.\",\"endings\":\"['Rose essential oil has properties that work on the entire nervous system. Ylang-ylang is used as a relaxer that can help with insomnia, anxiety and depression.', 'Blending eucalyptus oil, lavender essential oil and camphor oil can boost your energy levels, while ginger essential oils may help you keep your blood pressure in check. Honey essential oil, pineapple essential oil and banana oil take the trouble to blend together.', \\\"Rose essential oil is soothing on heart issues. Goddess's flower essential oil may help with anxiety.\\\", 'Rosemary can help, however, thanks to its soothing scent. Neutrogena essential oil works well for hypnosis and psychotherapy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}