{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67740bd8-8b95-5940-8331-5b4380f2eeb3","task_key":"default--validation--22017","task_revision_id":"1","upstream_id":"22017","short_description":"HellaSwag validation 22017","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to set up an llc in nevada [title] Choose a name for your business. [step] Under state law, every llc must contain words that indicate its business structure. Specifically, the name must include the terms \\\" limited-liability company, \\\" \\\" limited liability company, \\\" or \\\" limited.\",\"endings\":\"['\\\" alternatively, you may use one of the abbreviations \\\" ltd., \\\" \\\" l.l.c., \\\" \\\" llc \\\" or \\\" lc. \\\" [substeps] The name that you select must be distinguishable from any registered names of other existing businesses.', '\\\" [substeps] You can decide how you want your llc to operate, and if you\\\\'re close to the state of nevada. State llcs will not use the \\\" limited liability company, \\\" \\\" limited liability company, \\\" \\\" limited professional partnership, \\\" or \\\" limited.', '\\\" these words represent your llc\\\\'s target operating base. [title] Determine if your llc is a traditional business or a sole proprietorship.', '\\\" you don\\\\'t need to define the full name by simply stating \\\" llc \\\" instead. [substeps] To begin the name process, begin by writing down the legal name for your llc and the language in which you expect it to be written.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}