Evaluating the aesthetic quality in computer-generated renderings via a comparative analysis

Authors

Keywords:

Deep learning, Aesthetic, Architecture

Abstract

In architectural competitions, patrons often receive a multitude of design submissions. Often, it is hard for reviewers to evaluate all submissions in a fair and balanced manner. The research aims to investigate how computational models can assess aesthetic quality in architectural renderings by comparing human-judged scores with algorithmic predictions. Using a dataset of crowdsourced architectural competition entries from Arcbazar, different deep learning models are trained to predict and compare aesthetic scores and generate attribute-based heatmaps. These heatmaps visualize the regions that contribute positively or negatively to the perceived quality of the designs, offering explainable AI outputs. The method includes preprocessing the images, extracting perceptual features, and evaluating model performance through metrics. The results show a high correlation between predicted and actual scores, validating the model’s effectiveness. By using machine learning algorithms, a fair and efficient method to assess aesthetics across a large number of submissions is tried to be achieved. This study aims to contribute to the field by providing a transparent and replicable framework for aesthetic evaluation in architecture, bridging human perception and machine analysis. It also demonstrates how explainable AI tools can support assessments in design competitions and stimulate critical dialogue on aesthetics in computational design processes.

References

Arcbazar.com, Inc. (2022). Arcbazar. https://www.arcbazar.com/ (12.09.2023).

As, I., Pal, S., & Basu, P. (2019). Composing Frankensteins: Data-driven design assemblies through graph-based deep neural networks. In The 107th Annual Meeting BLACK BOX: Articulating Architecture’s Core in the Post-Digital Era (pp. 433-438). ACSA.

As, I. (2019). Competitions in a networked society: Crowdsourcing collective design intelligence. In Proceedings of the BLACK BOX: Articulating Architecture’s Core in the Post-Digital Era (pp. 268-273). ACSA.

As, I., & Nagakura, T. (2016). Architecture for the crowd by the crowd: A new model for design acquisition. International Journal of Architecture and Urban Studies, 1(2), 68-76.

Aydin, Y., Parham, M. A., & Hale, J. (2021). Using machine learning techniques to predict esthetic features of buildings. Journal of Architectural Engineering, 27(3), 04021023. https://doi.org/10.1061/(ASCE)AE.1943-5568.0000477

Basheer, I. A., & Hajmeer, M. (2000). Artificial neural networks: Fundamentals, computing, design, and application. Journal of Microbiological Methods, 43(1), 3-31. https://doi.org/10.1016/S0167-7012(00)00201-3

Bo, Y., Yu, J., & Zhang, K. (2018). Computational aesthetics and applications. Visual Computing for Industry, Biomedicine, and Art, 1(1), 6. https://doi.org/10.1186/s42492-018-0006-1

Talebi, H., & Milanfar, P. (2017, September 15). NIMA: Neural Image Assessment. arXiv. http://arxiv.org/abs/1709.05424 (09.11.2024).

Malu, G., Bapi, R. S., & Indurkhya, B. (2017, July 13). Learning photography aesthetics with deep CNNs. arXiv. https://arxiv.org/pdf/1707.03981.pdf (15.11.2024).

McCormack, J., & Lomas, A. (2020). Deep learning for individual aesthetics. Neural Computing and Applications, 32, 11727-11743. https://doi.org/10.1007/s00521-020-05376-7

Cross, N. (2001). Can a machine design? Design Issues, 17(4), 44-50. http://www.jstor.org/stable/1511919

Franco, A. B. (2019). Our everyday aesthetic evaluations of architecture. British Journal of Aesthetics, 59(4), 393-412. https://doi.org/10.1093/aesthj/ayz018

Hoenig, F. (2005). Defining computational aesthetics. In Computational Aesthetics in Graphics, Visualization and Imaging (pp. 13-18). The Eurographics Association.

Lennan, C., & Tran, D. (2018, October 30). Deep learning hotel aesthetics photos. NVIDIA Developer Blog. https://developer.nvidia.com/blog/deep-learning-hotel-aesthetics-photos/ (12.09.2024).

Kong, S., Shen, X., Lin, Z., Mech, R., & Fowlkes, C. (2016, July 27). Photo aesthetics ranking network with attributes and content adaptation. arXiv. https://arxiv.org/pdf/1606.01621.pdf (05.10.2024).

Senem, M. O., Koç, M., Tunçay, H. E., & As, İ. (2023). Using deep learning to generate front and backyards in landscape architecture. Architecture and Planning Journal (APJ), 28(3), 1-10.

Zangwill, N. (2001). The metaphysics of beauty. Cornell University Press. http://www.jstor.org/stable/10.7591/j.ctv1nhmzk

Yu, Y., Beuret, S., Zeng, D., & Oyama, K. (2018, September 3). Deep learning of human perception in audio event classification. arXiv. https://arxiv.org/abs/1809.00502 (07.12.2024).

Downloads

Published

2025-12-01