answered 8 years ago
Have you tried adding 'size' : number to your font dictionary?
'size' : number
http://matplotlib.org/api/matplotlib_configuration_api.html#matplotlib.rc