{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32d409fa-e013-5b5e-b2a4-a75f77e2afd5","task_key":"default--validation--49083","task_revision_id":"1","upstream_id":"49083","short_description":"HellaSwag validation 49083","config":"default","split":"validation","body":"{\"activity_label\":\"Travel\",\"ctx\":\"[header] How to stay safe at a cruise port [title] Check security threats before you book. [step] One of the best ways to make sure you stay safe at a port of call is to avoid going to any truly dangerous ports. Before you book a cruise, look over its itinerary and check with both your nation and the port's home nation to see if any threats are listed.\",\"endings\":\"['You can ask an agent at the port to activate security for you. Make sure you book your cruise for a minimum of a week or two.', '[substeps] Also look at other cruise websites and read reviews of ship workers and travel guides. You should be able to ensure that someone on shore is able to take care of the ship safely while you are docked.', '[substeps] Departments or ministries of state often issue travel warnings and alerts for international destinations. Call or check online with the appropriate government agency in your country to see if they have listed any warnings for any of your intended ports.', 'Good restaurants and safety practices will also help reassure you and aid in keeping yourself safe during your trip. [substeps] Determine if the cruise should be held at a hotel or resort first.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}