{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c3309b1-55ea-5ed7-9cf7-658b6f484091","task_key":"default--validation--10274","task_revision_id":"1","upstream_id":"10274","short_description":"HellaSwag validation 10274","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to draft an indemnity agreement [title] Search for samples. [step] You may be able to find a sample online that you can use as a guide for your own indemnity agreement. Many legal service companies also offer forms or templates to create an indemnity agreement, although you typically must pay a fee to access them.\",\"endings\":\"['[substeps] If you need to draft your own agreement, get permission from the judge to do so. Many court websites have sample agreements available for people to enact before in-court conversations.', '[substeps] Samples used by other companies also may help you decide how to word your clauses, or give you an idea of what kind of information you need to include. Make sure any agreements you look at deal with situations similar to yours.', '[substeps] You can use free software such as adobe acrobat that collects materials by using adobe acrobat. You can collect samples on your computer, or create an agreement by hand.', \\\"[substeps] Many banks, credit unions, and other private organizations offer sample outlines, while others also offer sample agreements. Look at the terms and conditions of your agreement to determine if you typically need to obtain a judge's approval to draft the agreement.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}