{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a2bd3b2-c7ea-58d5-8b8d-9e44fc5c1433","task_key":"default--validation--42654","task_revision_id":"1","upstream_id":"42654","short_description":"HellaSwag validation 42654","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to cure a skin rash under a ring [title] Visit your doctor. [step] In most cases, the rash is caused by contact dermatitis. This means that your skin is reacting to something in the ring.\",\"endings\":\"['Your doctor can diagnose if this is caused by a nickel allergy, dirt and sweat, or another underlying cause. [substeps] Your doctor may do a skin patch test to see if you have a nickel allergy.', 'The ring may be trying to hide the rash from you. [substeps] Talk to your doctor about setting up an appointment with a dermatologist if you notice a rash from your ring.', 'Contact dermatitis is a fungal infection of the skin underneath a ring. It causes a spot called a ring that is prone to forming scab formation.', 'Contact dermatitis occurs when a number of lesions are spread from the bite site to the animal. The lesions are localized in particular areas such as the face and the mouth, but rarely cause allergic reactions in these areas.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}