{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bbfe46de-5f48-5536-b196-2d942a30f1ea","task_key":"default--validation--27057","task_revision_id":"1","upstream_id":"27057","short_description":"HellaSwag validation 27057","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to find a second job [title] Do something different than your current job to avoid burning out. [step] Rather than working a similar job to what you already have, try to find something new and different. This helps you become more versatile of a worker and will help you develop new skills along the way.\",\"endings\":\"[\\\"[substeps] If you are relocating from the routine administrative job, finding a new, less stressful job can be difficult. Find a new job that makes sense to you as opposed to something that won't suit you.\\\", \\\"Maintain your current job if you know that you'll have to give up your current job. This will avoid the temptation to return your static position.\\\", '[substeps] If you work in an office during the day, consider working in a retail store or as a restaurant cook part-time. [title] Watch online job boards for part-time and temporary positions.', 'Try to do something different that will teach you more about your current job. [substeps] Almost any new job will work a little better, without getting boring and to the point.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}