{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8335ccb5-ed92-5aaa-8264-c8f4f6f36f2d","task_key":"default--validation--46320","task_revision_id":"1","upstream_id":"46320","short_description":"HellaSwag validation 46320","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to train someone to do your job [title] Give your notice. [step] Often, you will be training someone to do your job because you are moving into a new position within your organization. However, if you are leaving your current company, you need to give appropriate notice so that your employer know your position needs to be filled.\",\"endings\":\"['[substeps] Look at your employment agreement for any specific details regarding giving notice. Contracts or agreements may include language regarding how far in advance you give notice, and what medium is appropriate.', 'It is important for your employer to know what your responsibilities are and allow them to prepare an appropriate response. [substeps] Be sure to avoid speaking back to your superior.', 'The more informed you are, the better your chances of being hired are. If you are not sure how to research whether an employee should complete an interview, research the company or find out if they need to be contacted for an interview.', 'Ask your boss to notify supervisors of your current position so they can provide you with the appropriate notice for your position. When you give notice, be concise.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}