In the structure just before the boat landing, there are showers. You can either pay to enter Devils Lake State Park (which has great swimming and hiking) or get in for free with your national parks pass.
Showers are cold water only and not the cleanest, but they work well enough.