{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1c5bdfab-596d-5e75-8d65-ddbd62c225b9","task_key":"default--validation--39839","task_revision_id":"1","upstream_id":"39839","short_description":"HellaSwag validation 39839","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a nursing bra size [title] Buy nursing bras at the end of your pregnancy or 1 to 2 weeks after the birth of your baby. [step] The size of your breasts will vary greatly as your milk production adjusts to the demands of your baby, but they will usually level out in size by the second week. [title] Use a flexible measuring tape to measure around your torso, just under the breasts and under the arms.\",\"endings\":\"['[step] This is the first number in a bra size and indicates the band width. Add 3 inches (7.6 cm) to this measurement for the correct bandwidth for you.', '[step] You can find the measurement on the packaging. You can also do this by soaking a cotton ball or panty liner in warm water for 30 minutes.', \\\"[step] This will give you a give to your breast size when it's time to go shopping for nursing bras. [title] Buy a bra that is designed for working women.\\\", '[step] This will help confirm your milk production. You can buy advertising bras that have payouts (normally printed on the seam), or ads that label them as maternity bras.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}