{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"876b63a0-c289-5279-bfea-8155b2cb3a54","task_key":"default--validation--24432","task_revision_id":"1","upstream_id":"24432","short_description":"HellaSwag validation 24432","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to dry out a pimple [title] Ask your doctor about retinoid treatments. [step] Topical retinoids are gels or creams that you apply to your face as an acne treatment. They are an effective treatment for reducing acne.\",\"endings\":\"['These medications require a prescription from your doctor or dermatologist. [substeps] You will need to apply the medicine three times per week at first and then work up to applying it once per day as your skin adjusts to it.', '[substeps] You do not need to reuse a prescription retinoid. If your pimple is severe enough to warrant medical treatment, the doctor may advise blocking pores that provide deeper or more serious damage to the acne.', 'With the residue of acne treated, the pimple may disappear on its own. [substeps] Retinoids can be applied twice a day for 2-4 weeks, twice a week for up to 6 weeks, or more if the pimple stays there for longer than a day.', 'They are usually applied to your pimple twice a day, once in the morning and once in the night. When your doctor is treating you, they will inject the retinoids into the dermis which is where you see the blemishes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}