{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0d1d5bd7-2fbd-5165-89ea-190e183dc78c","task_key":"default--validation--32362","task_revision_id":"1","upstream_id":"32362","short_description":"HellaSwag validation 32362","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to retire in mexico [title] Consider if you need to hire a relocation consultant or specialist. [step] Moving between countries can be complicated. And there's no need to learn all the details on your own.\",\"endings\":\"[\\\"If you are moving to mexico, you need to find your precise position, what the country and time can give you, and possibly costs points. In order to figure out how much you need to accumulate and eventually-in the fall or summer months-you'll need to find out what the country your relocated to is.\\\", 'Relocation consultants or specialists exist that can help you with all the details your personal situation requires. Do keep in mind, however, that hiring a consultant or specialist will add to your retirement expenses, but in the long-run, it may be money well spent.', \\\"The problem is that while you may find the most uses in your home country, it won't offer the same kinds of benefits that a uk exit does. [substeps] Seminars are a great way to explore the different canadian destinations you visit and get some perspective while you arrange your accommodations.\\\", \\\"So in order to save money and be realistic about your level of experience, examine the following of an rc truck. [substeps] Adjust the values of your emissions levels based on your family's preferred use of the vehicle: license to drive, mileage, mileage, and interest rates for relocating.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}