{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bfe9975e-dd00-5cb2-a3ee-0001581a8870","task_key":"default--validation--32431","task_revision_id":"1","upstream_id":"32431","short_description":"HellaSwag validation 32431","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to rekey a lock [title] Get a rekeying kit. [step] Also called pinning kits, rekeying kits are available at most hardware stores and home centers, as well as online. [substeps] Kits are available for most lock brands and come equipped to do multiple locks, but frequently work for only locks of the same brand.\",\"endings\":\"['[title] Locate the right lock to rekey. [step] Each lock type has its unique lock components and the lock functions are the same.', 'If your car is more commonly locked than your home, you may want to stock your kit with pins and chains that come in slots that allow you to remove pins. [title] Remove the lock bolt that sits on the side that folds up to the wrench.', \\\"Check their name on the back of your lock kit. If one brand isn't working, you'll need to search.\\\", 'Some kits include only lock pins, while others include special tools (cylinder follower, ring remover, plug follower) to remove the lock cylinder so you can replace the lock pins. You can order extra pins if you have more locks to re-key than the kit has pins for.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}