{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74ad5a7a-4e2c-51a7-b897-5d6eb7b57c7f","task_key":"default--validation--507","task_revision_id":"1","upstream_id":"507","short_description":"HellaSwag validation 507","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to list references in a cover letter [title] Select the people you think would make good references. [step] Generally companies will ask for two to three references, if they ask for any references at all. Just in case, make a list of four to five people you think would be good, on the off chance that one of the people you select does not want to be a reference.\",\"endings\":\"['[substeps] People could include former employers, supervisors, and people who worked closely with your company. Most employers and supervisors do not want references that are beginning to devalue the company, so think about who your potential references are.', \\\"The more references you provide, the longer your cover letter will stay. [title] Dress professionally, don't wear shorts.\\\", '[substeps] You should still include the references in your cover letter. For example, if you need references from two previous people that worked in the same company, pick three people over three, and work backwards on the list.', 'You should pick people who have worked closely with you in a school or work setting. Choose former supervisors, employers, coordinators, or teachers or faculty members who can share information about the positive abilities, skills and qualifications you have to offer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}