Should I rush a house deposit because prices might rise?

I keep thinking I need to save faster because house prices could be higher by the time I'm ready. At the same time, rushing makes me feel like I'd make a worse decision. How do people handle that pressure?