Actually, you can use the method set_legend_options() to change the size of labels:
p = plot(x, legend_label='aha')