As a designer, consistency makes things feel right.
I highly recommend the font sizes across all sticky notes be consistent. For simplicity, you can choose an average size font for a sticky, and only make the font smaller if it truly doesn't fit vertically.
A larger font implies higher importance. Since we cannot control the font size, our voice to the viewer of our board is lost and their attention will be drawn to the wrong things.