{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e15c6525-6343-5c68-b2cd-399d50c3955c","task_key":"default--validation--42540","task_revision_id":"1","upstream_id":"42540","short_description":"HellaSwag validation 42540","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to buy government foreclosures [title] Learn about hud foreclosures. [step] Among homes available in hud foreclosure listings are home foreclosures from the irs, fdic and customs. A common source of hud foreclosures are when an owner defaults on a loan from the federal housing administration (fha).\",\"endings\":\"['\\\" government loan \\\" or \\\" government loan finance \\\" are atms that then receive the loan on a regular basis. The federal government also sells mortgage rates to protect the company and prevent foreclosures from getting bad if successful.', \\\"[substeps] The process begins when a homeowner with an fha backed loan defaults on their mortgage. After the home has been foreclosed on, hud pays off the remaining debt on the homeowner's fha loan.\\\", 'New and updated and newer buildings and political buildings-including neighborhood at both locations-compete for federal foreclosures. These property offers basic housing, but its environment can also provide private and public housing.', 'You can learn more by researching government foreclosures, if you are interested in acquiring the property yourself. A special process that the u.s.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}