{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"765412ac-1821-5f8d-9d71-6fd59e833983","task_key":"default--validation--12672","task_revision_id":"1","upstream_id":"12672","short_description":"HellaSwag validation 12672","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a period kit [title] Get a small bag or purse. [step] You need something to hold your kit! But make sure it is big enough to hold pads and, if you use them, tampons. [title] Get some sanitary products.\",\"endings\":\"['[step] Which you use will depend on the size of your pads, or how big your shower kit is. Women using either or men should find some sanitary products.', \\\"[step] You will be using this' kit' when you get home from school (not leaving your pads in the first place). You can be wrapping something around things to wear in the bag, for example, a tissue bag.\\\", \\\"[step] Usually, your first period is very light and just spotting, so pantyliners are perfect. For a heavier flow, you'll want pads or tampons.\\\", '[step] Socks are perfect for washing your body. Most stores just give you sanitary dish cloths.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}