{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3513fd39-18dd-50df-953d-3851133c5770","task_key":"default--validation--24952","task_revision_id":"1","upstream_id":"24952","short_description":"HellaSwag validation 24952","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with being a gifted student [title] Stay focused. [step] No matter how many talents, interests, or obligations you have, do not allow yourself to lose focus on your goals. [substeps] Prioritize your goals and decide which are most important and might need the most time considering your long-term objectives.\",\"endings\":\"['For example, if you have four jobs, and so many hours to devote to each one, this would be a great time to stay focused on doing those jobs. You might also try reading to keep your mind occupied while doing things you enjoy.', 'Make a list of your strengths and weaknesses and identify areas that need improvement. Put these down on your paper so that the focus stays on the positive aspects of your overall goals.', \\\"You can identify the' super star' or brilliant team in your circle, including the teen with the best moments. For instance, if you can't shoot longterm goals straight off the bat, then focus more on the good, time-critical things.\\\", \\\"Plan ahead and manage your time so that you can balance all of your obligations. Remember, you can't do everything! Identify clearly what you want to achieve and then find people, such as teachers, guidance counselors, and college professors, who can help you develop a step-by-step plan.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}