{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d01f377-1c8e-59b7-ba9e-e7ab32d117ca","task_key":"default--validation--20274","task_revision_id":"1","upstream_id":"20274","short_description":"HellaSwag validation 20274","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to root prune a bonsai tree [title] Remove the tree from the pot by gently moving it back and forth until it comes out. [step] Place it on a tray to keep the dirt in one place. [title] Use a root rake or chopstick and comb out the roots starting by the trunk and pulling down.\",\"endings\":\"['[step] Remove any drainage stones until you at least 6 inches (15 cm) from the roots. [title] Cut 2 \\\" x 4 inches (5.1 cm x 10.2 cm) pieces of aluminum tape to form a \\\" vine \\\" for the tree.', \\\"[step] If you have a smaller bonsai tree, you'll want to take down the main branches first. [title] Manually break branches into smaller pieces after getting rid of the green parts.\\\", '[step] Next, flip the tree over and rake out the roots on the bottom side. [title] Decide whether you want surface roots or not.', '[step] Most trees will split down the middle when they get one foot on each branch. Each tree might still be partially attached (dislocated) when you remove this tree from the pot.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}