{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7139ac0f-0d38-589e-9dce-aca5ad266d5e","task_key":"default--validation--8072","task_revision_id":"1","upstream_id":"8072","short_description":"HellaSwag validation 8072","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to develop in your career [title] Create a career plan. [step] You must have a clear picture of where you plan to be in 5 years , 10 years or 20 years down the road in your career. The first step to mapping your future success is determining the end destination.\",\"endings\":\"['While you can develop your timeline on your own without starting any of your main careers yet, by creating a clear plan, you can keep yourself motivated and prepared for long-term success. Focus on specific goals and move upward towards more specific goals as time passes.', 'Do not focus on the end destination or what is expected of you. Instead, be mindful of how much time you need to put into accomplishing your career goals.', '[substeps] As you examine the goals you would like to achieve in 5 years, your career will start to change considerably. As you examine the goal as you put together your life plan, you can decide how you plan to achieve it and if you would need to go into business for it.', '[substeps] Plan to review your career goals annually to determine if you still desire the ultimate objective in your plan. Career plans may change over the years as goals and desires change.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}