{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e7fb3ba-987c-5b53-9ef6-f427c616047a","task_key":"default--validation--17581","task_revision_id":"1","upstream_id":"17581","short_description":"HellaSwag validation 17581","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use birth control when nursing [title] Familiarize yourself with the different types of non-hormonal birth control options that are available to you. [step] Most of the non-hormonal birth control methods have been around for a long time, such as the diaphragm and the condom. You can also use a cervical cap or a vaginal sponge.\",\"endings\":\"[\\\"[substeps] Special cervical caps are also used on women who are given birth control pills in regards to birth control. They protect the cervical layers of a woman's vaginal tissues.\\\", 'These types of birth control methods will not affect the breastfeeding process or the health of your baby. They are safe to use and you can begin using them right away.', 'All of these options have greatly reduced your risk of having an unwanted birth. Take some time to consider the different kinds of birth control options and your experience as a mother to prepare for your baby.', 'The cervical cap is a cervical tube that is inserted through the cervix and into the vagina. [title] Take prescription birth control pills or contraceptives.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}