{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f457e89-82f9-554f-a08b-259ac0b1ddf4","task_key":"default--validation--20297","task_revision_id":"1","upstream_id":"20297","short_description":"HellaSwag validation 20297","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to resolve a construction dispute [title] Keep up to date on work being done. [step] Even if you utilize every dispute prevention process, you will not be able to avoid every problem. However, if you catch problems early, you can minimize the costs associated with fixing them.\",\"endings\":\"['[substeps] If a dispute ends up getting out of control, you can report the issue to an easement representative if necessary. You may want to talk to a representative that provides procurement services.', '[title] Do not assume that many repairs will be necessary. [step] Repairs are usually necessary if certain factors-as well as the amount of time involved in determining the fix-are being made.', 'In order to catch problems as they occur, keep an eye on your project and visit the site on a regular basis. [substeps] If you cannot visit your project site in-person, agree ahead of time that the contractor will contact you with updates at specific intervals.', '[substeps] Be on the lookout for a debt consolidation lawsuit, which is a lawsuit against creditors. In these lawsuits, creditors settle a dispute to rebuild the bottom line.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}