{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e061d84-9c0f-53a5-9b9f-5428da509b48","task_key":"default--validation--13513","task_revision_id":"1","upstream_id":"13513","short_description":"HellaSwag validation 13513","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to take legal action for a player contract breach [title] Read the player's contract. [step] Whether you can take legal action against the player will depend on what is stated in the contract. Accordingly, you should find the contract and read it from cover to cover.\",\"endings\":\"['You also need to read the contract closely and understand any specific provisions. If a player contract has a provision calling you player-protected, then you should read the entire agreement carefully to make sure that you agree.', '[substeps] The contract should include information about what the player wants. Typically, the player wants to go out and have sex.', 'Generally, you can take legal action in two situations : [substeps] The athlete did not fulfill an obligation under the contract. The athlete did something so serious that you can end the contract.', 'Look at how far in advance the player has been given a legal right to cross-examine you, and what conditions will be permitted. If you are interested in a trial, then you should read the provision in the contract and buy a day or two to go through it and see if you have an opportunity to bring a response to that.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}