{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ac5bdf4-0e52-5246-8e79-2b876feb2f12","task_key":"default--validation--41203","task_revision_id":"1","upstream_id":"41203","short_description":"HellaSwag validation 41203","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to become a youtube celebrity [title] Be sure that you will remain committed. [step] Before beginning, perform some research on the process of becoming an internet celebrity, and take the time to carefully consider your decision. Note that becoming a youtube partner is a difficult achievement that often takes months or years of commitment.\",\"endings\":\"['[title] Research news sources about being a wiki celebrity. [step] Although the internet privacy act only works with wikis, with a little research you can find a number of things about the wiki celebrity you would want to be.', 'You will have to remain open to criticism from your audience, and what you believe is entertainment may backfire, forcing you to change and adapt. However, it is important to also focus upon what you find fun so that your passion shows in your videos.', 'Be as informed as possible about the process and find ways to offer a solution that is suited to your needs. [substeps] All celebrities build fans online and in the networks that they are associated with.', 'Do not let slip-ups stop you from making smart decisions. Failing to follow through with your decision or changing your mind is a no-no.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}