What are your rpms? That seems really slow. When I tried to go that slow on brass it got messy. I do 35 ipm at 18k rpms with exactly your other specs- but am using TWO flute bit - maybe that’s why.
Do you have a good resource for brass? It’s very expensive around here and only slightly cheaper online.