{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a41a36bf-cfea-5049-8d7f-3b48e4ed166c","task_key":"default--validation--20483","task_revision_id":"1","upstream_id":"20483","short_description":"HellaSwag validation 20483","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to enjoy a caribbean cruise with children [title] Look for a cruise line that offers family-friendly accommodations and activities geared towards children. [substeps] Research cruise lines such as royal caribbean, norwegian and carnival. These lines have ships that include waterslides, rock climbing walls, miniature golf and arcades.\",\"endings\":\"[\\\"Compare the prices, family size, age and living arrangements of each ship. If your kids don't already have friends familiar with the ship or to whom they are glad to have the cruise, consider buying one from them.\\\", 'Reserve a cabin that is large enough to accommodate your family. Cabins are notoriously small on most cruise ships, so you may need to ask for an upgrade.', \\\"[title] Make sure you're not the only passenger on board. [substeps] Many ship owners and cruise companies will connect to friends or family on board.\\\", 'Different cruise lines have options for children to board as well as sunbathing. Looking for a cruise line that offers attractions like concerts, lounges, museums, and flea markets are also options.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}