{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95a3a8c5-3fc1-5e04-ac80-0a2272a8a7a3","task_key":"default--validation--34921","task_revision_id":"1","upstream_id":"34921","short_description":"HellaSwag validation 34921","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to braise celery [title] Wash and chop the celery. [step] Start with eight stalks of celery. Thoroughly scrub the celery, running it under water to clean it.\",\"endings\":\"[\\\"The extra water will help ensure that the celery isn't so fatty that it burns while you're braising it. Place the celery in the bowl you'll be braising it in, and rub it vigorously with your hands or a vegetable peeler to remove dirt and grit.\\\", 'Cut off the brown ends, and peel off the extra chewy part on the outside of the celery if you prefer. Chop the celery into 1-inch pieces.', 'Trim the celery just before you add it to a salad spinner. Then, chop each celery stalk into bite-sized pieces.', 'Chop the celery into pieces or chunks. If your kitchen is already equipped with good braising equipment, you can simply prepare the celery in batches to keep it from getting too soggy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}