{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59e6acff-eaf9-5f35-9da3-6f4ef0e1944a","task_key":"default--validation--5157","task_revision_id":"1","upstream_id":"5157","short_description":"HellaSwag validation 5157","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to prune lilacs [title] Cut fresh flowers in the spring. [step] When lilac flowers reach their peak and are just this side of fading out, cutting them to create indoor bouquets actually helps the plant. Left on their stems, the flowers will die but continue sapping energy that could be spent on new growth.\",\"endings\":\"['Pruning is also a good way to improve the quality of the new growth. [substeps] To trim daisies from their dormant season, you will need at least 1 to 2 flocking cultivars-the strawberries and cherry-as well as lots of mulch.', 'Cut back the flowers you plant with your scissors when cutting away branches and roots. [title] Prune deadwood breakcuts.', '[substeps] Go for blooms that peak midway up the stem, while above the rough boil. If you have the right palette, you can still produce blooms inexpensively.', \\\"So don't feel guilty or wasteful when you go outside with your hand trimmers to take off the prettiest flowers-you're doing just the right thing for your lilac bush or tree. [substeps] Another term for this type of pruning is deadheading.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}