For the metal/carbide burrs, spray some Wd-40 on them...It will keep the aluminum from building up on the edges of the cutter...It may get a little messy, but it should work...Another thing to do is to buy the metal/carbide burrs designed to be used on aluminum...They will have a higher helix angle cutting edge than the ones designed for steel/ferrous metals...You need to go to an industrial tooling supply store and take your current burrs with you and tell them what shapes of cutters you want and that you want the ones for machining aluminum...
That is what we used in the machine shop when machining aluminum...you will need to keep re-spraying every few minutes, but I doubt you are every really going to find a cutter that won't build up with aluminum, including the ones designed for aluminum...