{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87056bfe-e0d8-5871-8971-251bc76db814","task_key":"default--validation--46856","task_revision_id":"1","upstream_id":"46856","short_description":"HellaSwag validation 46856","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your children build their first budget [title] Establish an allowance. [step] If you want children to budget, you need to give them some money to work with. Establish an allowance for each child.\",\"endings\":\"['This allowance can be small expenses (such as getting bus tickets or agreeing to parent chores) or large items (such as your phone or television). Work out how much your child has and try to get a reasonable allowance over time.', 'This can be as small as just a couple dollars or as big as 1 , 000 dollars. Remember that this will have to be a total allowance.', \\\"Many parents decide to give their child one dollar for every year they've been alive. For example, your five year-old would earn $5 a week.\\\", \\\"This doesn't sound too much like making a fund. Money can be given for items like food or clothing, dental care, and free-time time.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}