Can I lose stomach fat by eating mostly vegetables and fruits?

I have a little bit of a stomach pooch and I really want it to go away! It never goes away by doing cardio for me, so I was wondering if i cut all refined sugar and pasta, bread, etc. and only eat vegetables, fruit, lean meats and only drink water/skim milk if it will actually help me lose the fat??