{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2fda8cbc-73a9-510d-8b3b-1d37f2941a83","task_key":"default--validation--30797","task_revision_id":"1","upstream_id":"30797","short_description":"HellaSwag validation 30797","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get married [title] Plan ahead to pop the question. [step] Your (hopefully) spouse-to-be should be surprised, delighted, and/or put a bit off-balance by your proposition. It is the sort of romantic moment most people live for, so be sure to get it right by planning it out early.\",\"endings\":\"[\\\"You will be surprised by their pleasure at the prospect of marriage, so don't be surprised when they have asked all the questions and no qualms. [substeps] Figure out your wishes, then talk it out with them beforehand.\\\", 'Put things off until you get married and you will be far more likely to visit the venue and get married on time. Also, try planning in advance to avoid the awkwardness of waiting until the last minute.', 'Think about the appropriate place, time, and words to say. Try to think of things your lover particularly enjoys-favorite restaurants, activities, and/or music-but for whatever reason does not get to indulge in very often.', \\\"Even someone you're keen to go on date with may get laid off. , try planning earlier, for instance, unless your spouse/to-be has a work-related medical issue that's contributing to his/her inability to get married.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}