{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25c9c5c5-9936-5619-8e6f-97d9e7b84e9d","task_key":"default--validation--18882--variant-b96e00ba90d4","task_revision_id":"1","upstream_id":"18882--variant-b96e00ba90d4","short_description":"HellaSwag validation 18882","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to resume working after retirement [title] Determine what you want in advance. [step] It's important to know what you'd like to do before you start your job search. That includes the field you'd like to work in and your potential job title.\",\"endings\":\"['You can use any window of opportunity you have available to make a final assessment of the specific position that you desire. [substeps] Right out of the gate area of your job search, let applicants know exactly what they need.', 'These things will help you map out the things that you need to do to get you back on track. [title] Network through job groups and/or sponsored mentor groups.', \\\"Ideally, you may wish to return to your previous field in a similar job. However, you may have to look into related or totally new fields if you can't break back into your previous line of work.\\\", 'While you could start just now, you should figure out what is open to you. [substeps] A good goal will be to earn enough money to continue working full time after retirement for approximately one year.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}