Research initiatives throughout history have shown how a designer typically makes associations and references to a vast amount of knowledge based on experiences to make decisions. With the increasing usage of information systems in our everyday lives, one might imagine an information system that provides designers access to the ?architectural memories? of other architectural designers during the design process, in addition to their own physical architectural memory. In this paper, we discuss how the increased adoption of semantic web technologies might advance this idea. We briefly discuss how such a semantic web of building information can be set up, and how this can be linked to a wealth of information freely available in the Linked Open Data (LOD) cloud.