{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"341abc2e-31a0-55c7-9c90-5fbe1795bc03","task_key":"default--validation--24768","task_revision_id":"1","upstream_id":"24768","short_description":"HellaSwag validation 24768","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create your own favicon icon [title] Create a favicon that represents your website. [step] The type of website you have should determine the look of your favicon. Try to design something that will adhere to your brand image and that will be recognizable and memorable to people.\",\"endings\":\"['If you have no idea where to start, then basic writing skills like \\\" get a javascript personal blog \\\" will do. *..-* * * *...', \\\"There are two types of favicons : [substeps] One that you type-anything that represents a content fact, such as that you're a writer or creator, should look like one of your relevant content. It should be labeled something that your work knows about.\\\", 'Before you start working on this campaign, write down detailed details related to your favicon. This will help your music content and your website feel special and outrange.', \\\"Your favicon will be the first thing that people see when they look at the tabs in their browser and will also appear in people's bookmarks. [substeps] For instance, if you have a food website, choosing a favicon that has a fruit or vegetable as the design may make it more memorable.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}