{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77c7ec4c-690e-5522-ba57-6b9d44cc3437","task_key":"default--validation--1485","task_revision_id":"1","upstream_id":"1485","short_description":"HellaSwag validation 1485","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to build a positive home for your kids [title] Practice what you preach. [step] Children take on a great deal of the beliefs, attitudes, and behaviors demonstrated by their parents. Therefore, it's essential that your presence in their lives reflects that of a positive role model.\",\"endings\":\"[\\\"Don't assume that your own actions reflect what your child believes or thinks of you. [substeps] Talk to and model what you preach regarding children in your bedroom.\\\", 'The popular saying \\\" do as i say not as i do \\\" simply won\\\\'t cut it here. If you smoke, drink, use swear words, or demonstrate prejudiced viewpoints, there\\\\'s a good chance your children will, too.', \\\"This means you need to keep up with the younger generations' belief systems, role model, and other role models in order to be encouraging and encouraging. You can do this by : [substeps] Inviting your friends to live in your home.\\\", '[substeps] Write down your statements about your ways and in, and make sure you discuss them with them regularly. Keep a record of your points with a pen and record them so everyone can see them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}