{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da43bfb4-37d4-5485-a48c-3ec03fdddbcf","task_key":"default--validation--18396","task_revision_id":"1","upstream_id":"18396","short_description":"HellaSwag validation 18396","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to freeze garden vegetables [title] Select young, freshly-picked vegetables. [step] Garden vegetables that have already been sitting out for several days will lose some of their freshness, and freezing may cause them to lose additional flavor. To ensure that the vegetables stay fresh for as long as possible, choose vegetables that are just barely ripe or slightly unripe.\",\"endings\":\"[\\\"[substeps] Check to see if your vegetables are in season. Fruits that are already ripe or ripe will hold up better in the freezer, and produce that hasn't yet dried will last longer if you're freezing the produce without straining the produce.\\\", '[substeps] Larger vegetables may add extra flavor and bulk by drying out more quickly, but will still last longer and be less processed. Aim for vegetables that are approximately 4 inches (10 cm) in length.', 'Steer clear of overripe vegetables which may go bad even when frozen. [substeps] Harvest your vegetables early in the morning and begin the freezing process immediately for best results.', \\\"[substeps] If you're not a fan of broccoli and potatoes, select veggies that can be eaten without them turning orange. [title] Decide how wet or dry the vegetables will be.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}