{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e2bbd34-062b-5061-9211-19e2e2156bc5","task_key":"default--validation--19698","task_revision_id":"1","upstream_id":"19698","short_description":"HellaSwag validation 19698","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to set realistic goals [title] Think about what you want to achieve. [step] The first step in setting any goal is deciding what you want. Most people have a general sense of things they want.\",\"endings\":\"[\\\"Instead of building on this sense, it's much easier to take control of yourself. Once you decide to set your goals, write them down on a piece of paper.\\\", 'Until you approach realistic goals, your thoughts will be a little open-minded. [substeps] Keep a notebook with thoughts about how much you want to achieve.', \\\"It might be happiness, health, wealth, or a better relationship with your spouse. Your first tasks is translating that into some things you'd like to actually accomplish.\\\", 'Whatever your goals are, identify them, and begin to set them in your mind. [substeps] For example, maybe you want to work more for fun and fulfillment than to live for class.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}