{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0dbc6074-91ac-5ef9-814f-107d6681e740","task_key":"default--validation--18939","task_revision_id":"1","upstream_id":"18939","short_description":"HellaSwag validation 18939","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to make a decongestant chest rub [title] Select your essential oil. [step] For your rub, you will need to select essential oils for congestion. You can use one essential oil, or a combination of several, to create a rub that will help with decongestion.\",\"endings\":\"['[substeps] Good essential oils for deconstipation include peppermint, mint, frankincense, and fennel. The essential oils are very good for congestion-they repel viruses and relieve irritation.', '[substeps] Peppermint, thyme, and grapefruit oils can be very useful to use for congestion and decongestion. [title] Pour 2 tablespoons of essential oil into a tea container.', '[substeps] Essential oils that help with decongestion include things like peppermint, basil, tea tree, eucalyptus, rosemary, pine, lavender, cloves, and thyme. There are many popular combinations of essential oils that work for chest rubs.', 'You can either find peppermint or mineral essential oils at your local pet store or online. [substeps] Peppermint essential oils are believed to have anti-inflammatory properties, which prevents inflammation and weakens tissue tissue, and are believed to help you breathe better.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}