Skip to content

Enhancing urban building energy models with Vision Transformers: A Case study in material classification from Google street view

Liu, Y., & Abbasabadi, N. (2025). Enhancing urban building energy models with Vision Transformers: A Case study in material classification from Google street view. Energy and Buildings, 333, Article 115457. https://doi.org/10.1016/j.enbuild.2025.115457.

View Publication

Abstract

The growing urbanization and increased urban energy consumption highlight the need for energy use and greenhouse gas emissions reduction strategies. Urban Building Energy Modeling (UBEM) emerged as a valuable tool for managing and optimizing energy consumption at the neighborhood and city scales to support carbon reduction goals. However, the accuracy of the UBEM is often limited by the lack of large-scale building façade material dataset. This study introduces a new approach to enhance UBEM by integrating an automatic deep learning material classification pipeline. The pipeline leverages multiple views of Google Street View Images (SVIs) to extract building façade material information, utilizing two Swin Vision Transformer (ViT) models to capture both global and local features from the SVIs. The pipeline achieved a main material classification accuracy reached 97.08%, and the sub-category accuracy reached 91.56% in a multi-class classification task. As the first study to apply a deep learning model for material classification to enhance the UBEM framework, this work was tested on the University of Washington campus, which features diverse facade materials. The model demonstrated its effectiveness by achieving an overall accuracy increase of 11.4% in year-round total operational energy simulations. The scalability of this material classification pipeline enables a more accurate and cost-effective application of UBEM at broader urban scales.

Machine Learning in Urban Building Energy Modeling

Abbasabadi, N., & Ashayeri, M. (2024). Machine Learning in Urban Building Energy Modeling. In Abbasabadi, N., & Ashayeri, M. (Eds.), Artificial Intelligence in Performance-Driven Design : Theories, Methods, and Tools: Theories, Methods, and Tools. Wiley-Blackwell.

View Publication

Abstract

Urban building energy modeling (UBEM) plays a pivotal role in effective urban energy management and the holistic understanding of citywide energy performance. This book chapter delves into the integration of machine learning (ML) in UBEM, covering applications such as predictive energy consumption modeling and optimization, and providing insights into how ML techniques enhance modeling accuracy and efficiency. It explores current UBEM methods, highlighting their strengths and limitations, and discusses the opportunities presented by ML for advancing UBEM approaches. The chapter also introduces a hybrid UBEM approach that combines data-driven and physics-based simulations to enhance modeling accuracy and reduce uncertainties in capturing urban energy use. This fusion of ML and UBEM offers promising prospects for improving urban energy management practices.

Understanding Social Dynamics in Urban Building and Transportation Energy Behavior

Abbasabadi, N., & Ashayeri, M. (2024). Understanding Social Dynamics in Urban Building and Transportation Energy Behavior. In Abbasabadi, N., & Ashayeri, M. (Eds.), Artificial Intelligence in Performance-Driven Design : Theories, Methods, and Tools: Theories, Methods, and Tools. Wiley-Blackwell.

View Publication

Abstract

This chapter explores the impact of human dynamics, social determinants of public health ( SDPH ), mobility, and occupancy on urban energy use behavior, a topic previously overlooked due to individual buildings or transportation models. A novel, data-driven urban energy model is developed using Artificial Neural Networks ( ANN ), augmented by Garson, Lek's profile and Partial dependence Plot ( PDP ) methods, to holistically evaluate urban energy behavior across Chicago communities, integrating both building and transportation energy use. Utilizing diverse public datasets from the city of Chicago, and validated through cross-validation, the model assesses human dynamics in development of an integrated urban energy modeling. The findings reveal a significant association between SDPH status, mobility, occupancy, and urban energy behavior with household income being a major contributor post accounting for urban spatial patterns and building physical attributes. The study suggests that meeting decarbonization targets in cities requires a broader evaluation encompassing various urban energy determinants. It advocates for emerging technologies and detailed analytical scrutiny, urging researchers and policymakers towards a comprehensive understanding of urban energy use behaviors.

A Hybrid Physics-Based Machine Learning Approach for Integrated Energy and Exposure Modeling

Abbasabadi, N., & Ashayeri, M. (2024). A Hybrid Physics-Based Machine Learning Approach for Integrated Energy and Exposure Modeling. In Abbasabadi, N., & Ashayeri, M. (Eds.), Artificial Intelligence in Performance-Driven Design : Theories, Methods, and Tools: Theories, Methods, and Tools. Wiley-Blackwell.

View Publication

Abstract

This chapter introduces a hybrid framework that brings machine learning (ML) and urban big data analytics into integrated modeling of indoor air quality, building operational energy, and ambient airflow dynamics. This holistic approach allows for more effective and accurate simulation results for the design of built environments that prioritize both climate and health considerations. To validate this framework, we undertook a pilot study on a naturally ventilated, large-size office building prototype, as provided by the U.S. Department of Energy. This prototype was hypothetically placed in a densely populated area of Downtown Chicago, IL. For our computations, we employed tools, including EnergyPlus, CONTAM, CFD0, and artificial neural networks (ANNs). The findings highlighted the proposed framework's robust ability to evaluate the effects of building energy efficiency strategies, such as natural ventilation. Additionally, it took into account the indoor concentration of outdoor pollution resulting from the implementation of such strategies. Employing the hybrid approach, we achieved an accuracy characterized by an R -squared value of up to 0.96, facilitated by ANNs. Compared to conventional physics-based simulation methods, the hybrid approach further accelerated the simulation process by up to 200 times. This novel framework offers valuable insights to architects and engineers during early-stage design decisions, enabling them to harmonize occupant health considerations with energy conservation objectives, thereby placing health and well-being at the forefront of decarbonization goals.

Exploring U.S. Occupant Perception Toward Indoor Air Quality Via Social Media and NLP Analysis

Ashayeri, M., Piri, S., & Abbasabadi, N. (2024). Exploring U.S. Occupant Perception Toward Indoor Air Quality Via Social Media and NLP Analysis. Journal of Environmental Science and Public Health, 8(2). https://doi.org/10.26502/jesph.96120205.

View Publication

Abstract

The global implementation of stay-at-home mandates altered people's activities within the built environment, prompting a slowdown in the spread of covid viruses. Nevertheless, this period shed light on previously unforeseen challenges in achieving "better" indoor air quality (IAQ) within buildings, necessitating a focus on building health resilience for future scenarios. This study aims to evaluate occupants' feedback on the impact of stay-at-home measures on IAQ perception in buildings across the U.S. during the first year of the pandemic (2020) and compare it with the baseline from the previous year (2019) nationwide to assess the changes and identify potential areas for IAQ management strategies. Geo-tagged textual data from X (formerly known as Twitter) platform were collected and analyzed using Natural Language Processing (NLP) based on time series sentiment analysis techniques to compute the feedback. Findings indicate that occupants’ negative feedback on IAQ increased during 2020 compared to the baseline. It was also found that public perception of IAQ in 2020 was notably less favorable, potentially due to deteriorating conditions inside homes as people spent more time indoors. The study underscores the potential of NLP in capturing occupant perception, contributing to data-driven studies that can inform design, engineering, and policy-making for sustainable future.

Keywords

Indoor Air Quality; Occupant Perception; COVID Stay-athome; Natural Language Processing (NLP); Time Series Sentiment Analysis

Bridging the simulation-to-reality gap: A comprehensive review of microclimate integration in urban building energy modeling (UBEM)

Worthy, A., Ashayeri, M., Marshall, J., & Abbasabadi, N. (2025). Bridging the simulation-to-reality gap: A comprehensive review of microclimate integration in urban building energy modeling (UBEM). Energy and Buildings, 331, Article 115392. https://doi.org/10.1016/j.enbuild.2025.115392.

View Publication

Abstract

Buildings are significant contributors to global energy consumption, necessitating urgent action to reduce energy use and associated emissions. Urban Building Energy Modeling (UBEM) is a critical tool that provides essential insights into citywide building energy dynamics though generating quantitative energy data and enabling holistic analysis and optimization of energy systems. However, current UBEM methodologies and tools are constrained by their reliance on non-urban-specific and aggregated climate data inputs, leading to discrepancies between modeled and actual energy expenditures. This article presents a comprehensive review of the datasets, tools, methodologies, and novel case studies deployed to integrate microclimates into UBEMs, aiming to bridge the modeling gap and to address the uncertainties due to the absence of real-world microclimate data in the models. It expands beyond conventional methods by elaborating on substitutional observational-based and simulation-based datasets, addressing their spatial and temporal tradeoffs. The review highlights that while remote sensing technologies are extensively utilized for building geometric data UBEM inputs, there remains an underexplored potential in reanalysis and observational-based products for environmental data; specifically, for the inclusion of parameters that are conventionally not included in UBEM analysis such as tree canopy coverage and land surface temperature. Furthermore, adopting a hybrid methodology, which combines observational and simulation-based datasets, may be a promising approach for more accurately representing microclimate conditions in UBEMs; as this process would ensure more representative climate parameter inputs and ground-truthing, while effectively managing computational demands across extensive temporal and spatial simulations. This could be achieved through integrating local earth observation datasets with computational fluid dynamics (CFD) tools or by merging local earth observational data with simulation-based reanalysis products and coupling these weather inputs with simulation-based building energy management models. Finally, this review underscores the importance of validating UBEMs with local microclimate weather data to ensure that model results are actionable, reliable, and accurate.

Leveraging earth observational data products and machine learning to enhance urban building energy modeling (UBEM) with microclimate effects

Worthy, A., Ashayeri, M., & Abbasabadi, N. (2025). Leveraging earth observational data products and machine learning to enhance urban building energy modeling (UBEM) with microclimate effects. Sustainable Cities and Society, 130, Article 106544. https://doi.org/10.1016/j.scs.2025.106544.

View Publication

Abstract

Urban Building Energy Modeling (UBEM) is a powerful tool used for sustainable design, urban planning, and efficient energy management, as it provides essential insights into the building energy consumption patterns. However, current UBEM methodologies often lack urban-specific microclimate data, leading to discrepancies between modeled and actual energy consumption. This research develops a bottom-up statistical UBEM framework that combines and integrates earth observational climate data, climate reanalysis products, and annual energy usage data, measured by the Seattle Energy Benchmarking Dataset, to capture the impacts of microclimates on urban building energy performance. Using machine learning techniques and Seattle, Washington, USA as a proof of concept, our results demonstrate that incorporating urban-specific microclimate data substantially enhances building energy modeling prediction accuracy. Specifically, three model variable schemas are compared; the optimal model incorporating earth observational data achieved a 0.16 (from 0.55 to 0.71) increase in testing R2 over the model that did not include any climate data inputs, and a 0.056 (from 0.66 to 0.71) increase in testing R2, over the model that included TMY3 climate data inputs. These findings validate the use of earth observational datasets for urban building energy modeling to include microclimate effects. Furthermore, machine learning algorithms outperform traditional linear methods, with respective ordered rankings: CATBoost, XGBoost, Random Forest, Decision Trees, and Linear Regression. Our study underscores the importance of integrating microclimate data into UBEM frameworks and advocates for the expanded use of earth observational and remote sensing datasets for mitigation of simulation-to-reality discrepancies; to ultimately inform more accurate energy-driven design and planning strategies at the city level.

AI-driven control algorithm using machine learning and genetic optimization for enhancing visual comfort in adaptive façades

Tabatabaei Manesh, M., Rajaian Hoonejani, M., Ghafari Gousheh, S., Abdolmaleki, A., Nikkhah Dehnavi, A., & Shahrashoob, A. (2025). AI-driven control algorithm using machine learning and genetic optimization for enhancing visual comfort in adaptive façades. Automation in Construction, 179, Article 106474. https://doi.org/10.1016/j.autcon.2025.106474.

View Publication

Abstract

Effective management of daylight and visual comfort in office spaces remains a challenge, as existing shading systems often lack adaptability to changing environmental conditions and occupant needs. This paper presents an AI-driven real-time shading control algorithm that optimizes visual comfort using machine learning-based surrogate models and evolutionary optimization. A non-conventional adaptive façade was simulated using Radiance and Ladybug Tools across nine U.S. climates. Four machine learning models were evaluated for predicting Task Illuminance (Et) and Vertical Eye Illuminance (Ev), with Extra Trees achieving the highest accuracy (R2
= 0.95). A Non-dominated Sorting Genetic Algorithm II (NSGA-II) balances glare reduction and daylight utilization by optimizing façade configurations in real time. In contrast to prior approaches constrained to fixed geometries and single-objective control, this paper introduces a generalizable multi-objective control framework. Results show that AI-driven optimization significantly improves adaptive façade performance, offering a scalable solution for intelligent daylight and comfort management.

Keywords

Smart façade control; Machine learning; Surrogate models; Visual comfort; Task illuminance; Vertical eye illuminance; Dynamic shading

A Comparative Evaluation of Polymer-Modified Rapid-Set Calcium Sulfoaluminate Concrete: Bridging the Gap Between Laboratory Shrinkage and the Field Strain Performance

Akerele, D. D., & Aguayo, F. (2025). A Comparative Evaluation of Polymer-Modified Rapid-Set Calcium Sulfoaluminate Concrete: Bridging the Gap Between Laboratory Shrinkage and the Field Strain Performance. Buildings (Basel), 15(15), 2759. https://doi.org/10.3390/buildings15152759.

View Publication

Abstract

Rapid pavement repair demands materials that combine accelerated strength gains, dimensional stability, long-term durability, and sustainability. However, finding materials or formulations that offer these balances remains a critical challenge. This study systematically evaluates two polymer-modified belitic calcium sulfoaluminate (CSA) concretes—CSAP (powdered polymer) and CSA-LLP (liquid polymer admixture)—against a traditional Type III Portland cement (OPC) control under both laboratory and realistic outdoor conditions. Laboratory specimens were tested for fresh properties, early-age and later-age compressive, flexural, and splitting tensile strengths, as well as drying shrinkage according to ASTM standards. Outdoor 5 × 4 × 12-inch slabs mimicking typical jointed plain concrete panels (JPCPs), instrumented with vibrating wire strain gauges and thermocouples, recorded the strain and temperature at 5 min intervals over 16 weeks, with 24 h wet-burlap curing to replicate field practices. Laboratory findings show that CSA mixes exceeded 3200 psi of compressive strength at 4 h, but cold outdoor casting (~48 °F) delayed the early-age strength development. The CSA-LLP exhibited the lowest drying shrinkage (0.036% at 16 weeks), and outdoor CSA slabs captured the initial ettringite-driven expansion, resulting in a net expansion (+200 µε) rather than contraction. Approximately 80% of the total strain evolved within the first 48 h, driven by autogenous and plastic effects. CSA mixes generated lower peak internal temperatures and reduced thermal strain amplitudes compared to the OPC, improving dimensional stability and mitigating restraint-induced cracking. These results underscore the necessity of field validation for shrinkage compensation mechanisms and highlight the critical roles of the polymer type and curing protocol in optimizing CSA-based repairs for durable, low-carbon pavement rehabilitation.

Keywords

calcium sulfoaluminate cement (CSA); polymer-modified confrete (PMC); rapid-set concrete; early-age shrinkage; temperature-induced strain; outdoor vs. laboratory performance; sustainable concrete; field performance; mechanical properties

2025 Innovation in the Construction Industry

Prof. Dossick’s CM515 Spring 2025 Class. Eds. Dossick, Carrie. & Ray, Lauren. (2025). 2025 Innovation in the Construction Industry. University of Washington. Pressbooks. Seattle, WA. https://uw.pressbooks.pub/2025innovationcm/

View Publication

Contributors
Abhishek Tripathy; Ashutoshsinh Shekhawat; Harshitha P S; Adam Hinds; James Mirie; John Ales; Shraddha Kalyani; Muhammad Abu Bakar Tariq; Mohamed Ibrahim; Mikhail Kamila; Manshuk Sabyrova; Nicholas Miranda; Nisha Tomar; Omid Keivanloo; Rahul Varma Alluri; Idris Soliu; Vidheesha Kasthoori Channapatnam Badrinath; Monica Korlepara; Vakkachan Johny Manipadam; Swetha Suresh; Vinay Singh; Vy Le; William Ackerman; and Yingjie Liu

Abstract

A collection of case studies about adopting new technologies and changing practices in design, construction, and operations of the built environment.

Keywords

Technology; Engineering; Agriculture; Industrial Processes