{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66f2c345-0e6d-57b0-99e0-dbb8350d92da","task_key":"default--validation--30355","task_revision_id":"1","upstream_id":"30355","short_description":"HellaSwag validation 30355","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to calculate the market value of equity [title] Make sure you use up-to-date information. [step] The market value of equity is constantly changing, and thus the calculation requires the newest information in order to be accurate. Stock markets are open from monday to friday.\",\"endings\":\"['Stock markets are not open monday through friday, and you can\\\\'t expect your stock to get \\\" up to date. \\\" [substeps] In times of the year when stocks are actually trading, there will be fluctuations between them.', 'This means that, from mid-april through july, most popular stock markets are open. [substeps] Look online for the month when there will be two stock markets open for you to preview the strength and overall cost of your investment.', \\\"If you need to calculate market capitalization on the weekend, then you will have to use friday's closing stock price. [title] Determine the total number of outstanding shares.\\\", '[substeps] Stock market securities are owned by a stockbroker, not a trust. A stockbroker is a corporation with a direct stake in a certain financial institution.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}