{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b65a3669-99c5-5e3e-a463-ad577c8860b4","task_key":"default--validation--9310","task_revision_id":"1","upstream_id":"9310","short_description":"HellaSwag validation 9310","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to write a marketing report [title] Consider why you should perform market research and write a report. [step] What information is important to you? What will you do with the marketing report after it is created? This process requires an investment of time and expense. Make sure that you have a clear plan for using the information that you collect.\",\"endings\":\"[\\\"[substeps] Talk to other consumers to find out what they think and they may get an idea of what your report is likely to end up doing. For example, many marketing writers are tech savvy and planning for the next year's sales are only 75 minutes.\\\", '[substeps] Market research is the process of evaluating how well your marketing efforts are working. Specifically, does your marketing get the attention and interest of prospects? Are you converting enough of those prospects into clients? [title] Identify your customer.', 'Take this low-key approach to analyzing your report. [substeps] \\\" idea analysis \\\" is a good way to find information and introduce it into your analysis.', '[substeps] Maybe you are 100% sure that the company has an effective, unionized environment. Help identify how this could affect you and your business.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}