{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25adb4fa-629e-51a8-82e0-dcdd4faa70d9","task_key":"default--validation--5550","task_revision_id":"1","upstream_id":"5550","short_description":"HellaSwag validation 5550","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your face look bright and awake [title] Use tea for more than just a drink. [step] The cold and caffeine in tea will bring down any redness, and there are great plant compounds in tea that naturally remove eye puffiness too. Green, black, and chamomile teas are best for their anti-inflammatory properties like caffeine.\",\"endings\":\"[\\\"You can combine them with teas like green tea. [title] Form bright smiles and don't put on fake lips.\\\", 'Experiment with different teas to find the one that is right for you. [substeps] Chamomile is a plant that has anti-inflammatory properties, so it will help relieve your puffy eye and prevent long-term eye problems.', '[substeps] Consider adding a few lemon slices to the tea to deepen its flavor. Lemon has antioxidant properties and increases elasticity of the skin.', '[substeps] Brew the tea by steaming water and putting the tea bags in to steep. After a couple minutes, drain the water and pop them in the fridge.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}