{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a117584d-3cb3-5231-b76f-56fef1d1c9a3","task_key":"default--validation--17824","task_revision_id":"1","upstream_id":"17824","short_description":"HellaSwag validation 17824","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your kids to be frugal [title] Teach children age-appropriate lessons. [step] All kids want an allowance, but in order to teach your children the true value of money, you may want to make them work for it. You can create a basic weekly allowance depending on good behavior and chore completion at an amount that is comfortable for you.\",\"endings\":\"['[substeps] A typical two to three month allowance will suffice for a young child. However, if your child asks for more money than they actually need, you may want to adjust this depending on whether they need to work for extra while their parents are away.', 'Then, create a chart that lists out how much they can earn for doing additional chores, such as washing the car, babysitting younger siblings, or helping with breakfast. [title] Make your kids earn money by completing chores.', 'Children who want to learn to act frumally by paying their social security checks on time are likely to get them an allowance. It is entirely up to you whether or not you desire to teach your children the value of money.', '[substeps] These allowances limit the costs of your house and help cut costs of household supplies and school supplies. Give your kids free raffles and theatre passes at appropriate times.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}