{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb2496fb-feef-5a1c-b666-448f21dbb5ba","task_key":"default--validation--44998","task_revision_id":"1","upstream_id":"44998","short_description":"HellaSwag validation 44998","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use petroleum jelly for beauty uses [title] Moisturize your face. [step] If you have chronic dry skin or tend to get dry patches in cold weather, petroleum jelly can be an effective moisturizer for your face. It creates a barrier over your skin that helps lock in the natural oils and moisture.\",\"endings\":\"['Massage it over dry areas of the face or apply a light coat to your entire face. [substeps] Even after you rub petroleum jelly in, your skin may be slightly shiny and tacky.', \\\"[substeps] Make sure you moisturize all of your skin--except your nose and chin--before applying petroleum jelly in these areas. Oils should not be placed on your face when it's cold or wet.\\\", '[substeps] To get the most moisturizer, apply it regularly while you are in the shower and before bed. Then, when you wake up in the morning, apply it to your forehead, under your eyes, and on the bridge of your nose.', 'However, the health consequences of applying petroleum jelly can be significant in determining whether you have oily skin or combination skin. [substeps] You can apply petroleum jelly as a moisturizer if you either have oily skin or/or have combination skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}