{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d503a957-6293-53e5-b51a-82ae02908484","task_key":"default--validation--24465","task_revision_id":"1","upstream_id":"24465","short_description":"HellaSwag validation 24465","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do perineal massage [title] Check with your healthcare provider before you begin. [step] Perineal massages can be harmful is you use too much force, not enough lubricant, or perform them incorrectly. To be safe, speak with your doctor about your plans.\",\"endings\":\"['[substeps] Your physician might recommend you start by massaging the hemorrhoid, which is around the top area of your anus. Use a small glob of anti-inflammatory cream or petroleum jelly around this area before and during the massage.', '[title] Sit in a warm bath for ten minutes. [step] This may help you relax before the massage, and loosen up the muscles that surround your perineum.', '[title] Know that massaging is not painful. [step] While it is important to consult your healthcare provider before attempting a massage, it is not painful for anyone but specific people.', \\\"Talk to them about what exercises you'd be willing to perform to safely perform the massage. [substeps] Progesterone is a hormone that is secreted by the body after exercise.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}