{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aba1c5b2-6e6e-59a0-a6e5-f540af22f002","task_key":"default--validation--32296","task_revision_id":"1","upstream_id":"32296","short_description":"HellaSwag validation 32296","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to reduce expenses in a company [title] Look over your expense report and cut unnecessary expenses. [step] The first thing you should look for are charges for anything that you don't use. For instance, you might have signed up for a free trial of a software service (saas) that you forgot to cancel, and now they're billing your company every month.\",\"endings\":\"[\\\"By looking at your expense report, you can easily begin making a comparison. Then you can review each expense differently depending on the product or service you have, the kinds of things that you're doing, or what the company is trying to change.\\\", 'Expenses like this are the easiest thing to cut to add a little cash back in to your budget. [title] Offer incentives to staff who help you cut expenses.', 'If you read over all that information you should simply turn in a paper copy and cut off that unnecessary expense to help you keep track of lost money on your monthly paper bill. [title] Keep unnoticeable expenses in mind.', 'All of that money just goes to taxes, but things tend to become variable if we cut out that much. [substeps] Go through your expense reports and check anything you do not use regularly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}