{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2850784-65e6-5e1a-a413-3961a9986753","task_key":"default--validation--37750","task_revision_id":"1","upstream_id":"37750","short_description":"HellaSwag validation 37750","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get children to save money [title] Start with coupons. [step] Beginning as early as 3-5 years of age, children can start to learn the rudiments of saving money and using coupons is a great way to do that. They can earn coupons for things like helping, for being cooperative, for clearing their plate-the possibilities are endless.\",\"endings\":\"['[title] Make sure when they are hungry try to teach them how to save. [step] If they are hungry, offer to help them.', 'If you are going to make a habit of saving money every week, try : [substeps] Introducing coupons or savings accounts at home. Checking your checks for money each month to find out if you have enough.', 'They can then save those coupons and exchange them for fun things to do. This is a great first lesson in saving.', 'However, it is important that you start with the most affordable means available to give children money. [substeps] Purchase coupons from your local grocery or supermarket.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}