Disadvantages of…

I am 5’10 165 pounds, I usually always ride a 157 or 159 but am now thinking about getting a t.rice in a 153. My main reason for doing this is because I wear a 9.5 boot, but I am also curious to see the difference in size. What would the disadvantages of downsizing be