{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5dd36bd0-b7db-59c7-b5d5-63d4c6c9f2ae","task_key":"default--validation--16656","task_revision_id":"1","upstream_id":"16656","short_description":"HellaSwag validation 16656","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to invest in rental real estate [title] Assess your ability to manage the property. [step] Being a landlord is not passive income or a part-time job. You will have many responsibilities when it comes to managing the property.\",\"endings\":\"['The following common roles are : [substeps] Owner. You provide legal or financial protection in the event that the tenant dies.', \\\"Paying the bills in a timely fashion will set you apart from other renters and the people who will be visiting the property. Working in a management role will set your business apart from the regular complacent tenants on leases, offer the tenants a taste of how property management options might work, and create a better view of the property's worth.\\\", 'You should ensure that you are able to manage the entire area of the property, even if it is one of limited value. Instead of being the sole owner, you will be responsible for paying rent to tenants.', \\\"This includes selecting and communicating with tenants, repairing the property when necessary, and dealing with a large variety of day-to-day issues. Make sure that you aren't already juggling too much with work and family before deciding to become a landlord.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}