Oh no, you can move domains without losing everything you've built. Links can redirect automatically, feeds can be re-fed, though it's hard, changing domains isn't that hard & I'd wager you'd see an increase in brand loyalty w/ an easy to remember name.