{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc7f0d2c-2281-5bec-a761-f15d4a8f935d","task_key":"default--validation--44265","task_revision_id":"1","upstream_id":"44265","short_description":"HellaSwag validation 44265","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to treat a yeast infection [title] Check for symptoms. [step] There are a number of physical signs that may indicate a yeast infection. The most common symptoms include : [substeps] Itching, soreness, and overall discomfort in the vaginal area.\",\"endings\":\"['Abnormalities in the appearance of your vagina. Infection or sores on the vaginal walls.', 'Itching around the lining of the vagina which changes frequently over the course of the day. Bloody vaginal discharge around the tampon.', 'You may also notice: dry, inflamed, pus-like discharge visible drainage from the vaginal opening. Diarrhea, vaginal constipation, and a sense of heaviness (possibly due to a blockage due to a yeast infection).', 'Pain or burning during urination or sex. Thick (like cottage cheese), white discharge in the vagina.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}