{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d9433c8-c454-54a8-8bdc-532750ae98a1","task_key":"default--validation--29953","task_revision_id":"1","upstream_id":"29953","short_description":"HellaSwag validation 29953","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to eat more fruits and vegetables [title] Think ahead to eating more fruits and vegetables and less junk food, and buy your foods accordingly. [step] Purchase fresh when it fits your budget and timing. Fresh fruits and vegetables can be more expensive, but are worth the money in nutrition and flavor.\",\"endings\":\"['[title] Build a pineapple-sized chest with atypical vegetables. [step] These are necessary because they provide quality juice and real nutritional value, both of which are key in establishing healthy eating habits.', 'Usually they can be eaten raw or cooked. Sometimes there is not a substitute for fresh.', \\\"[title] Avoid junk foods, like nuts, seeds, and dried fruit. [step] Even the local grocery store might provide substitutes that you don't normally eat, and trying to swap out the nutrients, can hurt your blood sugar levels.\\\", 'Even a small amount can help manage your hunger so is buying whole foods (unlike processed foods). [substeps] Canned fruits and vegetables should go with a balanced diet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}