{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2fd1ccf9-5186-5921-b9d3-6d954bc0fbc8","task_key":"default--validation--25863","task_revision_id":"1","upstream_id":"25863","short_description":"HellaSwag validation 25863","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a diamond ring [title] Wear traditional engagement and wedding rings on your left ring finger. [step] Traditionally, an engagement ring is worn on your left-hand ring finger at the time of your engagement. Your wedding band is added onto that finger when you get married.\",\"endings\":\"[\\\"This is so that it's not an outdated tradition for the band to go on your ring finger. As soon as you get married, put your ring on your pinky finger and loosely secure the ring with the other two fingers.\\\", 'This style does not have a traditional or traditional pattern. [substeps] If you wear a western ring and wear a western ring, the band should have a ranch ring on it.', \\\"[substeps] Most people wear their wedding band on their finger below the engagement ring, symbolizing that it's closer to their heart. When wearing your engagement and wedding rings together, slide your wedding band onto your finger first, then your engagement ring after that.\\\", 'Your ring is married on your ring finger when you get married. [substeps] Popular designer engagement and wedding rings come prearranged so as to make accepting your engagement ring easier.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}