{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4bc9f15a-356f-5048-bcd9-8b56194b4f4a","task_key":"default--validation--16625","task_revision_id":"1","upstream_id":"16625","short_description":"HellaSwag validation 16625","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to give a father of the bride speech [title] Don't be cheesy or have dad-jokes. [step] We have all been to that wedding with the disastrous father of the bride speech where the whole room is dying with embarrassment along with the bride. This is an opportunity to show your daughter your pride in her and the woman she has become.\",\"endings\":\"[\\\"Mark it appropriately and don't distract from it with cheesy one liners. [title] Start by introducing yourself and why you are here to speak.\\\", \\\"It's true your parents love her and see her as the best bride ever, but overdressing is a sure way to gain her confidence and make her happy. This is why you should avoid this many mannerisms and poses.\\\", \\\"[substeps] That includes telling her to be proud of her great hair, or her smiles, etc. This isn't suitable for a wedding where less attention is directed at her, so start with a non-cheesy speech about how much you love her.\\\", \\\"[substeps] Everyone-both mother and groom-get excited and enthusiastically about her father's upcoming speech. [title] Dress in your child's favorite clothing.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}