{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4df50fb-b1d8-5454-955e-3b059ce0824b","task_key":"default--validation--32236","task_revision_id":"1","upstream_id":"32236","short_description":"HellaSwag validation 32236","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a wedding planner [title] Get an internship at a wedding planning company. [step] Visit the websites of different wedding planning companies to see if they have any internship opportunities available. If you can't find one, apply to a banquet or event planning internship at a major hotel to get some relevant experience.\",\"endings\":\"[\\\"[substeps] As bridesmaids and groomsmen need to make friends to part with, they'll still be more likely to work with them if you can meet them face-to-face. Check wedding proposal websites for a list of appropriate internship opportunities for brides who live near sites like these.\\\", 'Alternatively, you can apply online and fill out an application yourself, or visit your bank or credit card company to ask for assistance. You may also have friends who have jobs looking for brides.', \\\"[substeps] Make sure your cover letter and resume are well written and up to date. If you're interested in a particular company but can't find any internship opportunities with them, don't be afraid to reach out.\\\", '[substeps] Completing interns at a wedding may, for instance, lead to you becoming a bridesmaid or a reception clerk at the reception of your wedding. Try to attend wedding day events in conjunction with internship or event planning work.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}