{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54652eab-f4d1-5e3d-bbe2-fb92fd9fbce3","task_key":"default--validation--20454","task_revision_id":"1","upstream_id":"20454","short_description":"HellaSwag validation 20454","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to discuss sex with your child [title] Start early. [step] If you get an indication that your child is being exposed to sexual information, then it is time to start talking with them yourself. Even infants are curious about their bodies, and by preschool age they may show an intellectual curiosity regarding others' bodies as well as their own.\",\"endings\":\"['By eight years old many kids are ready to have some form of a sex conversation with you. Remember to keep the conversation age appropriate, too.', '[title] Figure out what your child wants to talk about. [step] If your child seems interested in sex, discuss certain things you can do to encourage their curiosity.', 'Start by beginning the conversation by saying hello when they open the door. If they seem interested in the topic, make sure you contribute to the conversation by opening up about it and start making small talk every now and then.', \\\"[substeps] You should start trying to handle your child's sexual curiosity as soon as possible. Tell them that they are old enough and have a few questions for you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}