{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"682fd26c-11aa-5015-a1a4-abe1e9d51e47","task_key":"default--validation--6004","task_revision_id":"1","upstream_id":"6004","short_description":"HellaSwag validation 6004","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to pay capias warrant costs you cannot afford [title] Contact a friend or relative for the money. [step] If you do not have the funds available to pay the fees that you owe on the capias warrant, you may be able to borrow it. The easiest way to borrow would be a personal loan from a friend or relative.\",\"endings\":\"['If you know people who could afford the amount in question, reach out to them to ask for a loan. You may need to offer a small amount of interest.', '[substeps] For instance, suppose your relative sends a letter as soon as you pay the fee on the capias warrant. You may accept the bill without cash or interest, since you only have a few days to pay the fee.', 'One way to borrow money if you overspend is to write down your monthly expenses. This list may include house payments, childcare, medical bills, and student loan payments.', \\\"This will allow you to get a closer look at the signulum's application. If you have the funds available, the signulum will guide you to the nearest bank or credit union.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}