{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8c43990-427d-5932-b725-6f5f49ab5908","task_key":"default--validation--20986","task_revision_id":"1","upstream_id":"20986","short_description":"HellaSwag validation 20986","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to get tons of subscribers on youtube [title] Upload videos at least once a week. [step] One of the most important steps in getting more subscribers is to provide as much content as you can. The more videos you have, the more popular your channel will become as posting lots of videos makes people want to come back.\",\"endings\":\"['[substeps] More videos means more search result, which will lead to more subscribers. Do keep in mind though that posting too many videos every week will clog up your channel and make it hard for viewers to find what they are looking for.', 'A lot of youtube users are addicted to uploading videos every day. You should give your channel space to get people after you make video to try them on.', \\\"Making sure you're doing small videos every 3 hours could be the difference between getting thousands of subscribers and getting thousands of subscribers, as that shows online users this article got plenty of subscribers. [substeps] Have your video on stream regimes (seo, plasma tv, etc.\\\", 'Therefore, have the time you need to compose videos on top of a video on youtube to show some of your videos. [substeps] Post videos for videos that you enjoy and videos that will connect to your channel more than just the video you currently have.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}