{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7cc8464-070d-522e-9fda-4483733d2d5b","task_key":"default--validation--27422","task_revision_id":"1","upstream_id":"27422","short_description":"HellaSwag validation 27422","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to protect your ideas as a freelancer [title] Research the entities you plan on disclosing your ideas to. [step] It is possible to get a lot of information by asking your industry contacts about and searching online accounts of the business practices used by any party or organization you hope to share your idea with. The best way to protect your ideas is to be choosy about with whom you share them.\",\"endings\":\"['Be a good listener and thank everyone for their time and for their opinion of your invention. Put your problem somewhere that no one is more likely to locate it by searching for it.', '[title] Advertise your product or service in various publications. [step] When it comes to promotion, there are plenty of websites devoted to communicating with freelancers.', \\\"[substeps] Don't create a relationship with a business by letting it grow apart. Being personally connected to a business is a great way to remain in touch with your industry partners.\\\", '[title] Avoid giving away any details when pitching your ideas to third parties. [step] Otherwise, you may pitch your idea, only to find that it was developed by someone else, who was then given total credit for it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}