You can start anytime, I don't think there a right time, it's more of a convenient time. Just do the harder part of your shopping while you have the energy
U can start to buy every oda things now except baby clothes till wn u r like 20 weeks gone by dn u would v known d baby's sex.start buying dn bit by bit