The combined wealth of residents here amounts to over £450 billion, and the world's richest are still flocking to the town.