{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5c3626a-c324-5dd5-a808-e85e1e12787a","task_key":"default--validation--48450","task_revision_id":"1","upstream_id":"48450","short_description":"HellaSwag validation 48450","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to use a marine gps [title] Install your gps unit on your boat properly. [step] There are two types of marine gps units ones with internal antennas and units with external antennas. The gps devices with internal antennas are used on smaller boats with no top or cover since the receiver is built into the unit and it needs direct line of site to the satellites providing the signal to the device.\",\"endings\":\"['[title] Set up an outdoor outdoor antenna system of your choice. [step] The antennas help to fuse in the signal from the satellite receiver to the antenna systems included with it.', \\\"One of the cost differences between the three models of gps unit is the size of the camera-like unit. The smaller your camera unit is, the more water and marine data you'll want to store in your unit.\\\", 'The second ones are the external antenna units. In those cases, make sure the antenna is installed on top of the hard cover of the vessel and it has direct line of site to the satellites.', 'The transmitter is designed to function in conjunction with this transmission. [substeps] For boats with external antennas satellite radio.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}