{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb0dbbbd-93f0-5c16-83f5-67352b792b64","task_key":"default--validation--50522","task_revision_id":"1","upstream_id":"50522","short_description":"HellaSwag validation 50522","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to treat chin acne [title] Examine your lifestyle. [step] A variety of factors can contribute to the development of acne around the chin. Examine your own lifestyle to look for the culprit of your breakouts.\",\"endings\":\"['[substeps] Chronic feelings of inadequacy often manifest itself as excessive pressure in your temple, which can intensify hairline breakouts. If you continue to feel inadequacy, you may have a problem with the fact that your body has a blocked tear duct.', '[substeps] Are you excessively clean? This could include showering less often, going out in public, or and quitting smoking. Are you sober often? These things often affect the development of acne on the nose and mouth.', 'Call your doctor if you discover : [substeps] You drink four cups a day, or more if you do not. You are obese, carrying a heavy load, or drive heavy trailers.', 'If certain habits can be identified as the cause, they can altered or eliminated to lessen the severity of breakouts. [substeps] Are you a heavy make-up user? Greasy or heavily applied make-up can clog pores and have been known to cause breakouts.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}