{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19633db0-30f3-5e93-9a8e-dbe2e6ac3cc1","task_key":"default--validation--48784--variant-f2f67081b29f","task_revision_id":"1","upstream_id":"48784--variant-f2f67081b29f","short_description":"HellaSwag validation 48784","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope when your teenager falls in love [title] Give them space to experience their first love. [step] Your child will always be your child, even as they grow up, so you will always worry about them. But be supportive, give guidance and make an effort to be informed and involved in their life, rather than restrict or monitor everything they do.\",\"endings\":\"[\\\"[title] Understand that your toddler's first love comes now. [step] Once your child informs you of its first love, the relationship will go very slow.\\\", 'This will allow them to make the first mistake and feel ready to tackle another. [substeps] Encouraging them to experience their first love will help your teen become comfortable exposing themselves to their first love.', '[substeps] Giving them space to experience their first experience of love means letting them be responsible for their emotions and choices. Some of first loves may end quickly, some may persist, but each relationship will teach your teen valuable lessons about how to be with someone else.', 'You may be surprised to find that your teen may have developed a new love of literature or an interest in flower carving. This may be normal, but encourage your teenager to allow for this.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}