{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51f17bfc-83af-53ad-9125-207a4324c21f","task_key":"default--validation--44864","task_revision_id":"1","upstream_id":"44864","short_description":"HellaSwag validation 44864","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to treat tick bites [title] Grasp the tick as close to the skin as possible with a pair of tweezers. [step] Get the tips as close to the bottom of the tick as possible so it does not break when you pull it out. [title] Pull upward with firm, even force.\",\"endings\":\"[\\\"[step] Use one hand to grab ahold of the tick's tail, while simultaneously pulling upwards with your free hand. Switch hands and continue dragging and releasing as if you were about to pull it out of a water-filled container or directly onto a wet shirt.\\\", '[step] Do not pull hard enough, however, or you could bruise the tick. [title] Cut the tick quickly, using small, overlapping strokes.', \\\"[step] Use even pressure to pull the tick gently out of the skin. Don't twist, jerk, or yank on the tick or you could break the mouth off inside your skin.\\\", '[step] It should be soft enough to feel at your finger, but if it is too firm, use a tape wrap or even a binder clip to keep it away from your finger. [title] Let the tick drop into your hands.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}