{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"350b5e42-d65e-51ff-91f2-983590e84c10","task_key":"default--validation--1170","task_revision_id":"1","upstream_id":"1170","short_description":"HellaSwag validation 1170","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to transfer money between bank accounts [title] Ask a teller to transfer. [step] The easiest way to transfer might be to stop into the bank and ask a teller to move some money around. Have your account information available and state how much you want moved and where.\",\"endings\":\"['A teller may be open to letting you move funds anywhere you prefer and how much you want to transfer. This will allow you to transfer money from another account directly into the bank.', 'You might need to fill out some slips at the counter. The teller should be able to help you.', 'Ask the teller if there is a \\\" no processing fee \\\" fee for this service. [substeps] This fee can range from $25 to $75.', '[substeps] By moving your money, you are allowing your bank to know the funds being transferred. For example, in the us, the bank receives funds one month after a certain date as part of a maintenance check.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}