{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0685c91d-905a-5b22-b6ed-08bbba5f1e9d","task_key":"default--validation--12597--variant-9a8f4e2f42d2","task_revision_id":"1","upstream_id":"12597--variant-9a8f4e2f42d2","short_description":"HellaSwag validation 12597","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your child about budgeting [title] Pay with cash instead of credit cards. [step] Setting a good example is a big part of teaching young kids to budget wisely. Paying with cash instead of using a credit card at every opportunity shows them that things are bought with real money, not pieces of plastic.\",\"endings\":\"['Instead of investing in a monthly allowance, set aside money for easy-to-use deductibles like groceries, gas, dental care, or household maintenance. [substeps] Keep in mind that this rule applies to children under five years old, and precludes them from prioritizing saving.', \\\"Explain to them that it's easier to budget when you spend up front, rather than owing something later. [title] Take your kids along to the bank.\\\", \\\"You can do this by making a point of using cash for all meal/snacks and daily activities, as well as only paying for occasionally emergencies. [substeps] Don't stress about staying within your credit limit.\\\", 'Learning how to write down cash is an important skill for the young adult. [substeps] Take cash out every time you pay for groceries, rent an apartment, or finance the purchase of a car.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}