{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f58e345f-7219-5aa1-8dad-2cb1b395f526","task_key":"default--validation--32772","task_revision_id":"1","upstream_id":"32772","short_description":"HellaSwag validation 32772","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to wire transfer money [title] Learn about wire transfers. [step] A wire transfer is an electronic method of transferring funds from one person or company to another. One common method of sending a transfer is from one bank to another.\",\"endings\":\"['[substeps] You will have to walk and talk to the bank if you plan to transfer funds by person. If you intend to transfer your funds through your home, this method will also work.', 'The bank does not charge for the transfer. However, it might be better to send one to a third person than have them exchange the transfer with someone else.', 'Most wire transfers require an identification or credit card (such as a visa or mastercard) or cash (such as an atm atm card). If you have a credit card or cash, use it to transfer funds into another account instead of an individual one.', \\\"To send a wire transfer, the sender provides information on the receiving party's financial institution to their own bank. Once the transfer is complete, the sender's bank provides a confirmation number documenting the transfer.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}