I hate to be rude, but do you by an chance have dandruff? or psoriosis? (I know i spelled that wrong!) I am the only one in my house who gets that lint as well, but then I do have dandruff. I have found that I cannot use those hair brushes that have the little balls or knobs at the end of the bristle, this prevents me from getting the lint off. When I do wash them I use my shampoo to do so as I have allergies and do not wish to take chances. Once the brush is clean I mix a bit of fabric softener in water, let the brush soak in it for about 10 minutes, then rinse it clean and let it dry. This helps to keep the lint from sticking to the brush base. I also use a comb to clean everything out. If you can find a hair brush that is either set in wood or has a rubber, not cloth, backing to hold the bristles this helps as well. If all else fails I have found that the 99cent store ( or dollar store) usually has good brushes that fit all the requirements and I will buy 3 or 4 at a time so that if one gets to where I cannot get it clean, then I trade it out for a new one.

You may be washing your hair to often and causing dry scalp that would cause the lint to be worse in your brush. I am not saying you should have dirty hair, just see what happens if you do not wash it so often.