{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89308e46-baa1-5bb6-9fd5-d1cb582a6ab7","task_key":"default--validation--38608--variant-183643c98c63","task_revision_id":"1","upstream_id":"38608--variant-183643c98c63","short_description":"HellaSwag validation 38608","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to ease herpes pain with home remedies [title] Use ice on the area. [step] The simplest way to help relieve herpes pain at home is by using ice. Ice provides immense relief to most types of pain, as it numbs the skin and dulls the pain receptors in the area.\",\"endings\":\"['[substeps] Place your hand in the freezer and leave it there for about 10 minutes. Keep the ice in the freezer for 3 to 4 days, and try to reverse symptoms.', 'Put ice cubes in a bag to apply to the area. Leave it on for 10 to 20 minutes, and leave it on overnight.', \\\"[substeps] Cover the ice pack with a towel so that it doesn't get too cold. Then place the ice pack over the area with the sores.\\\", '[substeps] This method is used to treat long-term flare-ups by trying to keep the bite area cold and the area numb so the blood drains from the bite area. [title] Cover the area with a bandage or ice pack.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}