I know it is selfish, and not pretty, but it is true. When people leave a church pastors take it personally. It’s really hard not to.
Regardless of the stated reasons people give for moving on — and they are remarkably creative — the pastor takes it personally. You’ve just told him his baby is ugly. If you leave because “I’m not being fed here,” you’re telling the pastor, “I know you spent hours preparing that meal for me, but I didn’t like it.” (You wouldn’t say that to someone who invited you to dinner, but people seem to have no trouble saying it to pastors.)
Go ahead and leave a church, if you must, but don’t tell the pastor “It’s not personal!” on the way out. Of course, it’s personal.