{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92e16931-6fc8-5590-b794-f951c07e31ad","task_key":"default--validation--36347","task_revision_id":"1","upstream_id":"36347","short_description":"HellaSwag validation 36347","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to buff golf clubs [title] Wipe off any surface dirt or grass that is lodged in the grooves. [title] Fill your container-of-choice with several inches of warm (not hot) water and a small amount of any mild detergent. [step] Agitate until there is a sufficient lather.\",\"endings\":\"['Repeat after each use for every part of the ball, except for additional work if you have putts. [title] Rub soap into the entire side of the ball.', '[substeps] Set the container aside to dry for several hours or overnight to make the sanitation process easier. [title] Clean golf clubs and tees by : [step] Cleaning the grooves in the hollowed-out areas with mild soapy water.', 'The point of this testing step is that the bathwater products will dissolve the algae inside of your golf club and leave your club looking shiny and fresh. As you agitate the water, it will move the dirt around-lining the grooves and zippers.', \\\"[title] Immerse only the club's head into the solution for several minutes to allow any loose debris to disengage. [title] Use a wire-brush, toothbrush or small kitchen brush to remove any stubborn particles.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}