{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5bf10c5d-fe83-5163-bafd-7049fb6a2167","task_key":"default--validation--50580","task_revision_id":"1","upstream_id":"50580","short_description":"HellaSwag validation 50580","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a foster parent in new york [title] Read up on the responsibilities. [step] A foster parent provides nurturing care and a stable home for children who cannot currently live with their natural parents. Typically, children are removed because of abuse or neglect.\",\"endings\":\"['If you need help, ask a qualified foster parent. [substeps] A qualified foster care agency, if applicable, is responsible for providing foster care.', 'To prepare for this role, you should read up on the responsibilities you have experienced while serving as your foster parent. [substeps] To learn more about the responsibilities you will see, go to: https: // elevearcare.', 'Because the child probably suffers from trauma due to being separated from his or her home, a foster parent needs to provide patience, love, and affection in addition to food, shelter, and clothing. [substeps] You will also need to make sure that children get the mental and physical health care that they need.', \\\"For this reason, the foster parents are required to have a few years of experience with their child's household in order to have a high likelihood of earning legal custody of the child. [substeps] It can take several years to earn the license to be a foster parent.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}