{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"21af9032-928e-5396-b59b-000885447324","task_key":"default--validation--27533","task_revision_id":"1","upstream_id":"27533","short_description":"HellaSwag validation 27533","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get rid of the dark area around the mouth [title] Understand why you have dark spots around your mouth. [step] These spots result from high amounts of skin-darkening melanin in certain areas of your skin. This melanin can be set off by triggers from inside and outside your body.\",\"endings\":\"['These can include the following : [substeps] Exposure to natural oils. Sunburns are caused by skin exposing the mole in much the same way that exposure to ultraviolet light can expose it to full-spectrum sunlight.', 'Darkening spots can happen early on in life, but they are commonly found around traumatic events, such as a traumatic incident at work or around religious holidays. [substeps] People with dark spots may develop dark marks during pregnancy.', 'This melanin condition is called hyperpigmentation. The triggers might include sun exposure, melasma, and skin inflammation.', 'This can be accompanied by skin redness, itching, swelling, bad breath, and extreme sensitivity to light. The darker the spot, the more melanin it masks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}