{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b2fb8894-8332-5213-a05b-096d4223824a","task_key":"default--validation--44093--variant-f35e77565def","task_revision_id":"1","upstream_id":"44093--variant-f35e77565def","short_description":"HellaSwag validation 44093","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get married in new jersey [title] Pick a date. [step] Choosing the date of your wedding will be the most important decision you'll make when getting married. It will affect your venue, your attire and everything in between.\",\"endings\":\"[\\\"[substeps] Ask your date's family members to invite the bride and groom. See if they would be happy enough with the venue size and theme in mind.\\\", 'Choose a date that gives you enough time to get to your destination, in case you will need to lift the cab to get there. [substeps] Once you arrive at your destination, get some clothing in the car.', 'The best time to get married is one in august, or roughly two months after april or july 30. [substeps] Pick a day and time that has at least one date ahead of it.', 'Here are some factors to consider when picking a date for a new jersey wedding. [substeps] Weather-new jersey has a moderate climate, with humid summers and cold winters.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}