{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4b7ce8ef-c4e0-5dad-be76-930c5bf3fcb2","task_key":"default--validation--50230","task_revision_id":"1","upstream_id":"50230","short_description":"HellaSwag validation 50230","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to heal cracked skin [title] Check for infections. [step] You should start by checking for signs of infection. If the area is swollen, releasing pus or blood, or is very tender and painful, you should go immediately to your doctor or local health clinic.\",\"endings\":\"['Skin cracks are very prone to infection and these infections require professional treatment. [substeps] If you do not have health insurance (and you live in the us), go to the official listing of clinics for low income individuals.', '[substeps] Pimples can be caused by a number of conditions: oil glands, cracked skin, uveitis, excessive menstrual bleeding, subcutaneous blood clots, or an immune disorder that causes bacteria to grow. A damaged area will prevent blood from getting through the pore.', '[substeps] They should have a tape bag or package of sterile gauze. Sometimes doctors will refrigerate injured wounds and bandages.', 'Since cracked skin is generally contagious (2 , 900 to 900% of cases), it may have a bacterial problem. You should also go for a dna test or geological analysis to find out if contamination can be culprits.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}