{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7627f80-a155-56c3-a4e5-c0c03caccce4","task_key":"default--validation--6895","task_revision_id":"1","upstream_id":"6895","short_description":"HellaSwag validation 6895","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop procrastinating on the internet [title] Try the stop procrastinating app. [step] This software is compatible with both windows and mac computers, providing three options that will either cut you off completely from the internet or filter distracting websites while allowing you to continue to browse. You can download it from their website and install it following its instructions.\",\"endings\":\"['You can also easily change it using the restart commands on their website to access from a safe, low-cost, free-drive device. [title] Open a web browser to find the start menu.', \\\"[substeps] Even worse, an annoying website may stop you from seeing upcoming meetings or websites you'll never see again. These could be better tips at avoiding browsing up to 200 sites at once.\\\", 'With some smart devices, the app automatically commands you to \\\" wake up \\\" immediately. Other programs include : [substeps] Hotmail hotmail virtualbox: this is the most personal of all browser apps that can be safely installed and downloaded.', 'To use this software, you can set a time limit. This limit can be as short as one minute and as long as 24 hours, depending on how long you want to be disconnected.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}