{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9944f2e0-8835-5abe-9ac8-88ce3097c4c0","task_key":"default--validation--39659","task_revision_id":"1","upstream_id":"39659","short_description":"HellaSwag validation 39659","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to heal after acl surgery [title] Talk to your doctor about necessary medications. [step] After surgery, your doctor will recommend medications to help control post-operative pain; these drugs may be either over-the-counter pain relievers or prescription narcotic analgesics. In addition, your doctor may prescribe antibiotics for the first few days after surgery to minimize the risk of any infections developing.\",\"endings\":\"['[substeps] Make sure you understand how and when to take your medications, and read all labels carefully. Pain medication, in particular, can be dangerous and addictive if not used with appropriate caution.', '[substeps] This will depend on the extent of your surgical scar while you heal. It is possible to manage existing scar growth by trying to treat scarring and other trauma with drugs.', '[title] Avoid jumping into a drug-heavy diet. [step] Many people who go out of the house for physical activity after acl surgery do not see significant improvement in their recovery.', '[title] Reduce how much you interact with your doctor. [step] After surgery, your doctor may suggest that you avoid other people or your friends for a while.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}