{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e902e6c-1caa-5fe5-a6d1-15a47722e725","task_key":"default--validation--20020","task_revision_id":"1","upstream_id":"20020","short_description":"HellaSwag validation 20020","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help shy kids make friends [title] Talk with your child about if they want your help with making friends. [step] While most kids will be hesitant to admit that they want your help, assess if your child is actually bothered by their limited group of friends. Some shy or introverted children are happy with few or no friends.\",\"endings\":\"['[substeps] Shyness and avoidance around strangers is common, especially among shy kids. If your child shows you that they need more than a friend, that may lead to how they interact with others.', 'Others will only be concerned about their environment or select friends who have social support. Even some shy children are more than comfortable around a handful of friends that are also social, and risk being friended or disliked by others.', 'But some are really outgoing and willing to show off. [substeps] If shy or introverted children show a lot of enthusiasm for social interactions with you, then they might want to get more friends.', \\\"[substeps] Helping your child to make friends may be anxiety-provoking for them. Pay attention to your child's actions and body language.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}