{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c118d96c-0fe6-5ad4-a166-7572637011db","task_key":"default--validation--5374","task_revision_id":"1","upstream_id":"5374","short_description":"HellaSwag validation 5374","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to trust your parenting instincts [title] Be selective about the parenting books and blogs you read. [step] There are as many parenting styles as there are parents, and if you try to follow every piece of advice you come across, you'll quickly become confused and discouraged. Listening to too much advice can drown out the voice of your own intuition.\",\"endings\":\"['Find just a few good parenting resources that resonate with you, and leave the rest. [substeps] For example, many parenting books are meant to be inclusive of all sorts of issues and concerns.', \\\"Instead, listen to your instincts and see if you feel comfortable sharing your feelings with the people around you. [substeps] Some parenting books even advise you to consider your perception of others' emotions or opinions.\\\", '[substeps] Depending on the type of parenting, parenting books are a great option. Look for parenting magazines, films, audio books, and online sources.', '[substeps] Check with respected parenting magazines or academic journals to see if your child follows every parenting book and blog. [title] Tell your child about their obsessions with their numbers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}