{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"efdb5de0-1b22-569e-8bc2-aff3cb78b4f6","task_key":"default--validation--48801","task_revision_id":"1","upstream_id":"48801","short_description":"HellaSwag validation 48801","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to create a website without knowing html [title] Register a domain. [substeps] Before you even think about building your website, you should register a domain name. A domain name is the thing that looks like this: \\\" yourdomain.com \\\".\",\"endings\":\"['[title] Decide whether you want to make a webpage on a computer or create your own website. [substeps] Another domain name is \\\" beolroomsstartbuildbuilder.com \\\".', 'You will have to register your domain name and theme on a form on the webpage titled \\\" html template. \\\" in your community or at a local community college you will need this as your web domain name.', 'Your domain name represents the url (or permanent web address) of your website. Therefore, when anyone types in \\\" yourdomain.com \\\" or \\\" www.yourdomain.com \\\", they will see your website.', 'So if the name is \\\" yourdomains.html \\\", you would have to register it first. Enter your domain name and email address at the top of the website.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}