{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e6f7484-db57-5faf-8b9e-9b33b6f536e6","task_key":"default--validation--20732--variant-bffe0c33c2cc","task_revision_id":"1","upstream_id":"20732--variant-bffe0c33c2cc","short_description":"HellaSwag validation 20732","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to make vegetables taste better [title] Marinate vegetables. [step] Some vegetables, when cooked without any spices or additional flavorings, can be a little bland or even bitter in flavor. Spice up the flavor potential of vegetables you're preparing with marinades or other seasonings to make them more enjoyable.\",\"endings\":\"['[substeps] A marinade is a seasoned sauce that vegetables, meat or even tofu can be put in to add a lot of flavor to a meal. Marinades need to have a little salt, fat and acid to help the vegetables soak up the sauce.', \\\"[substeps] Keep in mind that this method is most commonly used for vegetables like beans, peas, radishes, onions and other leafy vegetables. Place the vegetables in a very clean and cool spot in your refrigerator, such as where the vegetables aren't in direct sunlight.\\\", 'Find some season-of-the-week whole vegetables and sauté them in olive oil. Sauté your vegetables for about 4-5 minutes.', '[substeps] When you cook vegetables, do so in a bowl or frying pan large enough to completely cover the vegetables. Marinades often make very bland vegetables, so empty the bowl just before placing the vegetables and marinades into the pan.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}