{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d919a2e-0b4b-56c0-8d53-293397714b62","task_key":"default--validation--19887","task_revision_id":"1","upstream_id":"19887","short_description":"HellaSwag validation 19887","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to buy dessert wine [title] Familiarize yourself with the different types of dessert wine. [step] There are many different types of dessert wines. They vary based on the grapes used and how they are prepared.\",\"endings\":\"['In general, fresh grapes are more nutrient-dense, giving them flavor and providing added nutrients. Fortified sauces are sweeter than flavored types.', \\\"Here are some of the popular wines available to buy including : [substeps] Wineries wine stemware blanc downkin' champagne distilled @79 l wine red wine butterworth sparkling wine 150b [title] Find the right wine. [step] Wine and other beverages look similar when mixed on different days of the week.\\\", 'Some are alcohol, such as pink wine, sweet wine, and red wine. These juices tend to be marketed as very simple and low calorie, making them best served with flat or leafy grain.', 'The dessert wines can be divided up as follows : [substeps] Noble rot wines: this type of wine is made from rotten grapes. The grapes are covered in a mold called botrytis cinerea, commonly known as noble rot.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}