{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7395d551-2728-55ec-b216-a5a164500d51","task_key":"default--validation--19057","task_revision_id":"1","upstream_id":"19057","short_description":"HellaSwag validation 19057","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to reduce financial risk [title] Familiarize yourself with the different types of risk. [step] Most financial risk can be categorized as either systematic or non-systematic. Systematic risk affects an entire economy and all of the businesses within it; an example of systematic risk would be losses due to a recession.\",\"endings\":\"['Non-systematic risks are those that vary between companies or industries. These risks can be minimized through careful planning.', 'Within the institute, there are a large number of sectors in charge of investments. Each industry has a model of its own.', 'Non-systematic risks can include : [substeps] Collapse of contracts. Many auto dealers fall behind on shipment prices because they have problems with their customers.', 'What happens to the business once lost revenue is the time and specific experts like vendors, owners, managers, and other professional people who raise money into system. From there is a sort of unpredictability.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}