{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb3d54ba-a76a-5892-8355-f48099754828","task_key":"default--validation--4156--variant-9de84a9aa7e1","task_revision_id":"1","upstream_id":"4156--variant-9de84a9aa7e1","short_description":"HellaSwag validation 4156","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to set a default browser on iphone or ipad [title] Install the browser you want to use. [step] You can download alternatives to safari (such as chrome or firefox) for free from the. [title] Free up space on the dock.\",\"endings\":\"['[step] If you want to use the chrome browser for internet surfing, get to the root of the browser and launch it. Go to the chrome dock and double-click on the file to launch the browser.', '[step] To change the default browser settings, tap the backspace icon in the dock. It will expand on a new window and display a list of all browsers saved from your computer.', \\\"[step] If you already have 4 apps on the dock (the row of icons at the bottom of the home screen), you'll need to remove one to make room for your browser. For example, if you don't want safari on the dock, remove it and replace it with a different browser.\\\", '[step] You will be using the default tab of safari if you add this to your chrome home page. The default tab is in the top-left corner of safari window.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}