{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dda5ad9c-6cc4-5d47-8955-3a960aa1406b","task_key":"default--validation--28038","task_revision_id":"1","upstream_id":"28038","short_description":"HellaSwag validation 28038","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to cook beet greens [title] Trim off the stems (optional). [step] The stems are edible, but not everyone likes their bitter taste. If you're not willing to try them, cut off the stems just below the leaves.\",\"endings\":\"['You can remove the thick stem base from the largest leaves as well, cutting them out in a v pattern. [substeps] Like all greens, these will sauté down to a much smaller volume.', '[substeps] You can leave the stems whole, if desired, or cut them into crosshatched pieces. Either way, it makes the produce taste sweeter and more meaty.', \\\"Mature beet greens will last longer than leafy greens like spinach or kale, so only cook them when necessary. [substeps] If you're too picky about drying out the greens (or don't like the bottom of the beet greens), however, you can safely cut the stems off of your beet greens instead.\\\", '[substeps] Note that beet greens have different stems than carrots, so trimming them down is important. You can eat them fresh, or dry.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}