{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9fedd0de-9e12-52f8-9ced-df1164fb0d09","task_key":"default--validation--2328","task_revision_id":"1","upstream_id":"2328","short_description":"HellaSwag validation 2328","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to address email with attn [title] Begin the subject line with attn. [step] In some cases, such as a job application, you may only have a generic email for a company, but want to gain the attention of a particular person or department. The best way to do this is to write in the subject line as \\\" attn: john smith.\",\"endings\":\"['\\\" in the beginning, it will sound as if you are only inquiring for a job, not a position. [title] Specify the position you are applying for.', '\\\" you can leave this blank if you want it to describe yourself. [title] Present the name of the individual or department that is addressing the email to immediately after the subject line.', '\\\" [substeps] Use a quick and clear way so anyone reading your email can understand why you\\\\'re writing your email. [title] Begin the subject line with the sender\\\\'s full name and email address.', '\\\" [substeps] Alternatively, if you do not know any names, you could write \\\" attn: hiring manager \\\" or \\\" attn: marketing department. \\\" [title] Include other pertinent information in the subject line.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}