{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5bc185dc-d171-5f0e-b1a8-c1f137332401","task_key":"default--validation--7739","task_revision_id":"1","upstream_id":"7739","short_description":"HellaSwag validation 7739","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to prune lantana [title] Prune your lantana before it blooms for best results. [step] Typically, lantana plants bloom through the spring and fall. Trim your plant in the late winter or early spring before it hits the growth period for optimal flower yield.\",\"endings\":\"['[substeps] Trimming the plant too early can cause it to rot and look raggedy, which is a warning sign that your plant might go bad. Use a shop-bought line or a pen or pencil to mark where your plant should be cut.', 'Pruning before this time will prevent your plant from producing fruit. [substeps] There is not usually a time period for pruning.', '[substeps] If your lantana is taller than 37 centimeters (24 inches), you should wait one month before pruning it. If you prune your lantana before it blooms, you could be directly impacted by the evergreens.', \\\"[substeps] While you don't have to prune your lantana plants, it helps them spur new growth and look great in your garden. If you live in the northern hemisphere, you can prune your lantana plants in june.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}