You will need a backcountry camping permit to camp ... spots for rafting in the entire state of Washington, so it’s one of the best things to do in Leavenworth if you’re keen on adventure.