What's your opinion on giving breastfed babies Water?

bpv101283

My son is 5 months old next Saturday. He eats 6 times a day. Usually 3 to 4 of those are bottles of breast milk. He gets too annoyed by my breasts that the milk isn't coming out fast enough. We've been fighting that a few weeks now. He just nurses before bed and early AM. He just started a tablespoon of oatmeal with 1 to 2 oz of BM 2 times per day. He is still hungry! He is probably around 18 lbs, maybe a little more and 27 inches long. He is a big boy. I didn't want to start any solids till 6 months, but gave in because he was eating so much BM and still screaming. I am going to call the pedi and see how they feel, but what is the opinion on giving a couple of oz of water to baby?

 Edited to change title to water.  I was on my iphone and totally wrote formula when I meant water!