These days, the prospect of buying a vacation home is still alluring, but trickier to pull off than just a couple of years ago. Mortgage rates have risen from historic lows, and inventory remains low.

The region is the quintessential vacation destination with over 150 percent ratio in second-home-to-primary-home residences. However, buying a home here doesn't come cheap. The average home value ...