Yes first factor will be loading time and I think that most important factor is the content of the website. If your content is unque and useful to the most of the visitors they would like to visit it again. I have seen that many websites having same content floating around internet. So according to me if you want to have more visitors and want to bring your visitors again to your site Content is a key.