{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"16e1a55f-04e6-5af2-8b4e-ba68a4b0a72a","task_key":"default--validation--46268","task_revision_id":"1","upstream_id":"46268","short_description":"HellaSwag validation 46268","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to refinance student loans [title] Evaluate your loans. [step] Federally-guaranteed student loans are funded by the government and have a number of benefits. Private student loans can come from a variety of lenders including banks, credit unions, state agencies, or schools.\",\"endings\":\"['Generally federal student loans have lower interest rates than private loans. Some federal loans also allow for a grace period upon graduation.', '[substeps] You must have a collegiate purpose in your student loan loan loan loan. You can simply go into the process without paying the necessary installments (interest on the student loan loan loan) that you can pay by using a standard refinancing interest rate.', 'The downside to federal backed student loans is that they tend to be less secure, making them more complicated to refinance. [substeps] These loans go against federal and state debt payments, which results in your refinance.', '[substeps] Before you try to refinance in this way, you should consult with an officer at a bank and discuss your plans with them. Loans put your team in place to move the assets to a better position for the school.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}