{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9769dd34-a1fa-5fed-a213-5d9c7080bba6","task_key":"default--validation--27251","task_revision_id":"1","upstream_id":"27251","short_description":"HellaSwag validation 27251","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to ensure success with options calendar spread [title] Make sure you have software to plot your risk graph. [step] When trading straight calls or puts or vertical spreads (all legs on the same month), it is relatively easy to work out the max risk, max profit and break even point to draw risk graph. However, calendar is a horizontal spread that makes up of two different option months.\",\"endings\":\"['The magnetic banner machine and schedule trap are the materials that will help to make up your watch. This requires pure (80-20 %) efficient network support.', 'That makes it almost impossible to manually and accurately plot your risk graph. So, you need software to do this.', 'Zero times, it is possible to not manage your numbers carefully, but spreadsheet apps are built in. The different spreadsheets have a variety of variables in them.', 'To create one option, select file] new, and name your choose your absolute header dataset. You will then quickly input data for each recent call or spread.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}