{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"17194453-542a-531d-b992-128a9eeb4292","task_key":"default--validation--21194","task_revision_id":"1","upstream_id":"21194","short_description":"HellaSwag validation 21194","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to deal with hating your job [title] Craft a list of things you dislike about your job. [step] Begin by developing a list of things that you dislike about your job. Don't leave anything out.\",\"endings\":\"[\\\"Most job seekers like to list things they don't like about their job. Try to wrap up your list with five things you dislike.\\\", 'List as many issues as you can before breaking any of the list. [substeps] For example, maybe you hate having small things on your desk because your boss makes it seem \\\" outdated \\\" to you and you don\\\\'t like it.', 'Start keeping a daily journal and write down how you feel about different aspects of your job, your colleagues, your immediate supervisor and the environment in general. Doing so will reveal the most dreadful points that may need immediate action.', 'Label it \\\" negative \\\" or \\\" challenging \\\", and if you can identify what you dislike about your job you can use your list to redesign your job profile. [substeps] You could send your list to a variety of different employers, but if you know they\\\\'ve gotten more than you expected due to how close your workers are, develop a new list of things you dislike.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}