{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df8caefd-66c6-507b-87a9-009457fbe37c","task_key":"default--validation--17816","task_revision_id":"1","upstream_id":"17816","short_description":"HellaSwag validation 17816","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to plan an affordable beach wedding [title] Choose your location. [step] A beach wedding is typically free or fairly cheap. If isn't free, you will probably have to purchase a permit that could range from $30 to $300.\",\"endings\":\"['Often people take days or weeks to arrive-some would agree at least two days or less. Different locations will leave you with favorable views on the beach.', \\\"Once you've committed to beach wedding, plan the exact location. Some of the most affordable beach wedding destinations are in mexico, hawaii, and jamaica.\\\", \\\"Make sure you've paid out a fair rate of business. [substeps] Cheap beaches also offer younger couples, who can skip the fees.\\\", 'On that note, you should also consider where your wedding will be held. If you want a beach-themed wedding, the beach can obviously be your destination.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}