{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97f878e1-0689-51a5-9af2-3807c9bb5cf8","task_key":"default--validation--25463","task_revision_id":"1","upstream_id":"25463","short_description":"HellaSwag validation 25463","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to boost salads with whole grains [title] Add quinoa for a protein boost. [step] Quinoa is an ancient seed from south america that has recently surged in popularity. It can be found in many supermarkets and health food stores, and you may frequently see it listed on restaurant menus.\",\"endings\":\"['Quinoa is one of the few plant-based foods that contains complete proteins, which means it contains all nine of the essential amino acids. Add a cup of cooked quinoa to your salad to add 8 grams of protein to your meal.', '[substeps] Check at local grocery stores if your grocery store does not carry quinoa. [title] Spread a ripe green salad over your greens.', 'For any healthy meal, you should add a lot of whole grains to your old salad. For example, go for 2 oz (210 g) of whole grain pasta , 2 ounces (40 g) of whole grain noodles, and 3 oz.', 'It has a pungent and leafy flavor, and contains a ton of fiber. You can add a handful of quinoa to your salad for added fiber and lean protein.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}