{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69c21a6e-9fd1-521e-ab8d-e3945f0a7a57","task_key":"default--validation--28832","task_revision_id":"1","upstream_id":"28832","short_description":"HellaSwag validation 28832","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prevent uti during pregnancy [title] Stay hydrated by drinking plenty of fluids daily. [step] Water can help flush bacteria from your system, preventing new infections and perhaps even flushing the beginnings of an infection from your system. [substeps] Drink six to eight 8-ounce glasses (1.4 to 2 liters) of water every day.\",\"endings\":\"['Water also helps flush toxins from your system, including histamines and peptides, as well as unwanted bacteria and diseases like tumors. [title] Do not use mucotropin as an alternative to prescription medications.', 'Even the gentlest drinks will help you hydrate. Large children and adults should limit the amount of water they consume every day and, if possible, drink as little as one to three liters (1.4 to 1.5 l) of water daily.', 'Consider adding lemon to your water to increase the acidity of your urine and fight bacterial growth. Drink unsweetened cranberry juice daily.', 'There is no particular minimum amount of water you should drink while pregnant, but eight glasses (1.2 liters) of water per day is a good starting point. [title] Get at least 6 hours per night of sleep.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}