{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66ab3bd6-a0d9-59e6-8ffa-0337a265ea6c","task_key":"default--validation--42899","task_revision_id":"1","upstream_id":"42899","short_description":"HellaSwag validation 42899","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have a smooth underarm shave [title] Apply an oil. [step] Moisturizing the skin under your arms plumps it up, so there's less likely to be irritation when you shave. Instead of a regular moisturizer, though, you want to use something that offers more intensive hydration.\",\"endings\":\"[\\\"Try out a spritz of shea butter as you shave to find the most hydrating and moisturizing amounts. [substeps] Don't leave your moisturizer on overnight.\\\", \\\"Any type of oily skincare product should work, but peanut butter or coconut oil are also good choices. [substeps] If you don't have a regular moisturizer that blends in with your skin, you'll need to apply a small amount to the skin around your armpit.\\\", \\\"That's why it helps to apply an oil at least 24 hours before you plan to shave. You want to give the oil enough time to fully absorb into your skin.\\\", \\\"[substeps] You could use anything from facial shampoo to tea tree oil. Castor oil will help hydrate your underarm, and it doesn't require a rub-down.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}