{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3648f70-b920-5334-ad96-3333a65865ec","task_key":"default--validation--41410","task_revision_id":"1","upstream_id":"41410","short_description":"HellaSwag validation 41410","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get work as a freelance writer [title] Peruse freelance marketplaces. [step] Freelance marketplaces act as a medium between you and potential clients. Some freelance websites sort by subject, while others sort chronologically.\",\"endings\":\"['Find clients who are looking for writing you think you could do, and send them your profile, resume, and portfolio. [substeps] Some popular online freelance marketplaces include freelancer, guru, and upwork, though there are many others! Most freelance marketplaces take a cut of the earnings for connecting you to the client.', 'A good rule of thumb is to stick with one article at a time. [title] Ask a variety of people to help you and observe you.', 'They often round the pages, increasing your contact with people who are eager to get you started. In this way, you can be perceived as part of an active market.', \\\"In general, available freelance marketplaces tend to pool funding and others track their sales. Consult online marketplaces to get an idea of whether they're offering freelance work for your ideal audience, whether you've got an immediate family, if they offer freelance writing services, or which kind of platform they are offering.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}