{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23b4160f-4e75-54aa-a273-d95d3e489d5d","task_key":"default--validation--49562","task_revision_id":"1","upstream_id":"49562","short_description":"HellaSwag validation 49562","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to enter gps coordinates in google maps [title] Go to google maps. [step] Open any web browser on your computer and visit the. [title] Enter gps coordinates.\",\"endings\":\"['[step] The search box will appear at the top of the map when you enter the correct coordinates. \\\" gps coordinates \\\" stands for \\\" to determine location.', '[step] Type in the latitude and longitude of the location in the search box on the upper left corner of the page. Be sure to observe the proper formatting of the gps coordinates so that google maps can interpret and find the location.', '[step] For the appropriate search method, go to the google maps website at. Enter the area code for wherever you live.', '[step] Enter gps coordinates in the address bar of google maps\\\\'s address bar or directly in the \\\" address bar \\\" text box that appears at the top of google maps\\\\'s map window. [substeps] For example, if you are typing a street address in the address bar, enter it in the blue field at the upper right corner.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}