{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87712718-9a1b-5aa0-b9b7-2eb4cc6b6957","task_key":"default--validation--17987","task_revision_id":"1","upstream_id":"17987","short_description":"HellaSwag validation 17987","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle discipline like supernanny [title] Be united in your approach to discipline. [step] Discuss your disciplining actions with your significant other and all of the people who take care of your kids in your home. Supernanny jo frost always tries to ensure both the mother and father are on board with the same teaching method and approach, for consistency's sake.\",\"endings\":\"['Everyone in the home needs to stick to the same rules and consequences. [title] Establish some \\\" house rules \\\" for the children.', \\\"[substeps] To respect the adult's needs, set aside time once every day to discuss your discipline. Also, step away from the baby's room each night to talk to both parents together.\\\", \\\"[title] Love and respect your baby's spirit as much as you love the child. [step] Always refer to your child in their name.\\\", '[title] Learn how to throw a tantrum, no matter how appropriate. [step] The primary goal of the supernanny jo frost training is to try and shut out all negative or stupid attention-seeking ways from the child.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}