{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00b6d4a1-d64c-5508-a2af-99ae13fa98ec","task_key":"default--validation--32884","task_revision_id":"1","upstream_id":"32884","short_description":"HellaSwag validation 32884","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach financial literacy [title] Explain how to accurately estimate income and expenses. [step] Make a spreadsheet or write a sample monthly budget with a pen and paper. List total income, and break expenses up into categories, such as car payments, insurance, a cell phone bill, and entertainment.\",\"endings\":\"['[substeps] Mention that income and expenses can fluctuate month to month, so tracking them over time is important. [title] Make the sample budget relevant for your student or child.', \\\"In this way, you can monitor your income across months, as well as the average income at all times, and make sure everyone's established in your home. [title] List what you don't know.\\\", \\\"Form the precise measurements and terms you wish your child's education to learn at a later date. [substeps] Make it up as you write the statement.\\\", '[substeps] You could also use small, \\\" i average 6% as a monthly income \\\" sections. Also make sure to include basic expenses like the above.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}