{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"233d6d70-d47e-5d49-9827-85bb06855a4e","task_key":"default--validation--41955","task_revision_id":"1","upstream_id":"41955","short_description":"HellaSwag validation 41955","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with someone hogging the sheets [title] Tuck part of the sheet under you. [step] Try tucking the side of the sheet under your body before you go to sleep. That way, your partner won't be able to pull it all the way off you.\",\"endings\":\"['[title] Tuck the sheet edges under the mattress. [step] If you move around too much to hold the sheet down yourself, or if your partner is much stronger than you, try tucking both sides under the mattress.', \\\"You don't want to still have half of the sheet tucked under you the next morning. [substeps] Another way to secure your side of the sheet is to tuck it under your breasts, between your underwear and the headboard (soft padding).\\\", \\\"If you're napping on your back, you might want to tuck the sheet under your pillow so it is out of the way. [substeps] You don't need to worry about creating a lot of space.\\\", \\\"[substeps] Another option is to use a piece of fabric folded over your body but keeping it tucked in under your body. Adjust your sheet around your body as needed so that the raw edges of the sheet don't continue to get in the way of your natural sleeping position.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}