{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67a70930-fa2b-5450-8ffa-1b7ad242ce04","task_key":"default--validation--44668","task_revision_id":"1","upstream_id":"44668","short_description":"HellaSwag validation 44668","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to protect your watch [title] Wear any bracelets or chains on your other wrist. [step] Wrist jewelry has the potential to scratch either the sides or the face of your watch. Only fabric or thin leather bracelets would be acceptable along with a watch.\",\"endings\":\"['There are some very simple homemade jewelry choices, with necklaces, neck bands, rings, etc. , used to protect your watch from scratches and corrosion.', 'If you have friends or family who also have watches, then they can help protect you from scratching. [title] Protect your watch more than you wear it.', 'Avoid metal on the same wrist, no matter what. Friendship bracelets, knitted and crocheted bracelets are not harmful either.', 'Avoid wearing silver or gold bracelets on your other wrist. Lighter wrist settings will wear away the scratched effect of your watch.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}