{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"91374a35-917b-5b43-9f40-f35d4e19069d","task_key":"default--validation--12495","task_revision_id":"1","upstream_id":"12495","short_description":"HellaSwag validation 12495","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use prenatal massage techniques [title] Wait until your second trimester to have a prenatal massage. [step] The highest risk of miscarriage is during weeks 1 to 12 of a pregnancy, so most massage therapists avoid massaging women in their first trimester. [title] Lay on your side for a prenatal massage.\",\"endings\":\"['[step] There are specialty tables available with a uterus-sized cutout to allow a woman to lay on her stomach, but those tables can still apply dangerous pressure to the abdomen and pull on uterine ligaments. [substeps] Use pillows to prop yourself on your side.', '[step] Now that you are pregnant, your first trimester is usually the best time to have a prenatal massage. However, pregnancy can also cause uterine contractions and abdominal cramps.', \\\"[step] If you have twins or have a newborn, this position might help relieve pain and ease your soreness. [title] Place your dominant hand under your baby's diaphragm-tum-if your baby has a diaphragm.\\\", '[step] The most common position for a prenatal massage is on your side, but some women also find it more comfortable to lie down with a baby in their lap while pregnant. Prenatal massage involves an upward flow of massage oil into your uterus and creates pressure when stimulated.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}