{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"55f97db6-edfb-5254-a681-2e320b0311af","task_key":"default--validation--42468","task_revision_id":"1","upstream_id":"42468","short_description":"HellaSwag validation 42468","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to stop scratching a mosquito bite [title] Scratch yourself near the itch. [step] Anyone who has ever had a broken bone and worn a cast knows, sometimes you just can't scratch an itch. One way to get some relief is to scratch someplace else on your body.\",\"endings\":\"['You can hit any mosquito bite on your foot, head, chest, arm, or thigh. In contrast, you can scratch anywhere else if your clothes contain any anti-itch products, white socks, or gloves.', 'Hand massage a mosquito bite area, use your fingers to scratch away any oils from your hands, rub any microscopic flakes of skin, the scratch marks and at the same time soothe the area. [substeps] If your bite is itchy for more than a few hours, wipe it with a washcloth and cool water.', \\\"This little mind trick relieves your body's desire to scratch without further inflaming the mosquito bite. [substeps] You can try scratching near the itch, such as in a large circle around the bite.\\\", 'Take a hot dog, a hot water bottle, or even a tick off your foot that ticks off your entire body. [substeps] Note, that this method has no large colony of mosquitoes but a little self-soothing scrub.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}