{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d57dd91e-bd9f-5dab-ba39-8ad8d145adcc","task_key":"default--validation--40313","task_revision_id":"1","upstream_id":"40313","short_description":"HellaSwag validation 40313","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be confident during a beauty pageant interview [title] Watch interviews from past pageants. [step] It's hard to be confident when you don't know what to expect from the interviewing process. One of the best ways to prepare yourself is to watch the pageant interview section from past years.\",\"endings\":\"['There are many recordings of major beauty pageants on online sites like youtube or pageant websites. [substeps] You can also try to get in touch with the organizers of the pageant if you are competing in a small or local pageant and see if they can connect with recordings.', \\\"Although you may feel like you have no experience as a pageant reporter, watching interviews from past years can greatly help you know what to expect at the pageant. [substeps] Don't feel pressured to video interviews if the interview is upcoming.\\\", \\\"Look at interviews from the decades surrounding the pageant. If you've attended pageants, try to see the differences as lines on the runway.\\\", \\\"Don't limit yourself to pre-pageant interviews, though. Find out where you want to go, then spend some time thinking about the interview format and the number of scenes required.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}