{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"10ebe24d-2043-52ea-8696-ce33d1bde72f","task_key":"default--validation--31546","task_revision_id":"1","upstream_id":"31546","short_description":"HellaSwag validation 31546","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a wedding ring [title] Wear your wedding band on your ring finger. [step] Your ring finger is the finger next to your pinkie on your left hand. This tradition originated in ancient rome, where is was believed that the vein in the ring finger ran directly to the heart.\",\"endings\":\"['Wearing your ring finger on your hand will help to prevent this from happening. [substeps] Although these steps have been put into place, rings must not be worn between the ages of 60 and 65.', 'The romans called this vein the \\\" vena amoris \\\" or vein of love and wore their wedding bands on this finger as a way to signify romance. This is a pretty cute reason to wear your ring on your ring finger.', 'Now, the guild and dragonmen find themselves in a knot with their ring fingers secured to the ring. They will tie their ring engagement ring onto their wrist.', 'On this ring finger, there was a tiny hole where the sapphire stone should have been. When you wear it, a majority of the time, the ring remains squarely on the heart, though it could be just a little bit taken off.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}