- Open Access
Review and analysis of augmented reality literature for construction industry
Visualization in Engineering volume 1, Article number: 9 (2013)
Research has identified various beneficial capabilities for augmented reality technologies in the AEC industry such as virtual site visits, comparing as-built and as-planned status of projects, pre-empting schedule disputes, enhancing collaboration opportunities, and planning/training for similar projects. This paper provides an expanded foundation for future research by presenting a statistical review of augmented reality technology in the AEC industry. The review is based on articles found within eight well-known journals in architecture, engineering, construction, and facility management (AEC/FM) until the end of the year 2012. The review further narrows the literature within these journals by considering only those 133 articles found through a key word search for “augmented reality.” The selected journal articles are classified within the following dimensions: improvement focus, industry sector, target audience, project phase, stage of technology maturity, application area, comparison role, and technology. The number of articles within these dimensions are used to identify maturing and emerging trends in the literature as well as to synthesize the current state-of-the-art of augmented reality research in the AEC industry. In summary, the AR literature has increasingly focused on the demonstration of visualization and simulation applications for comparison of as-planned versus as-built statuses of the project during the construction phase to monitor project progress and address issues faced by field workers. In addition, the future trend is toward using web-based mobile augmented systems for field construction monitoring.
The complex nature of the architecture, engineering, construction, and facility management (AEC/FM) industry and its high demand for access to information for evaluation, communication and collaboration, increases the industry’s need for information technologies. Recent visualization technologies such as virtual and augmented reality technologies are ideal in this environment.
Overview of augmented reality
Augmented reality gives a view of the real world where elements are superimposed by computer generated files such as graphics, sounds, videos, or digital information. From the first see-through head-mounted AR display developed in the 1960s by Ivan Sutherland at Harvard (Sutherland, 1968), to the enhanced HD4AR and Mobile Augmented Reality System (MARS) developed by Golparvar et al. (Bae et al. 2012), augmented reality technologies have been used in various disciplines and arenas, e.g. engineering, entertainment, aerospace, medicine, military, and automotive industry, as a frontline technology to meet visualization difficulties in their specific domain (Behzadan and Kamat 2011).
The AEC industry is also moving to embrace more AR technologies for improving various stages of construction projects. This advanced computer technology provides significant advantages through simulation and visualization of the construction industry, e.g., allowing the observer to interact with both the actual and the virtual objects and to monitor the construction progress by comparing the as-planned and as-built status of the project (Shin and Dunston 2008). AR technologies can benefit the AEC/FM industry in at least three levels: visualization, information retrieval, and interaction (Dong and Kamat 2013). Various applications of AR have been recommended for the AEC/FM industry by different researchers. Dunston and Wang (2005) proposed AR systems for AEC industry to support all phases of the constructed facility project life cycle. Wang et al. (2007) explore potential AR applications in heavy construction equipment operator training. Golparvar-Fard et al. (2009) developed a 4-dimensional AR model for automating construction progress monitoring, data collection, processing and communication in construction phase of the project. Behzadan et al. (2011) investigate a mobile 3-dimensional AR system for visualizing dynamic site operations during the construction phase. Waugh et al. (2012) developed a web-based augmented panoramic environment to document construction progress. Park et al. (2013) presented a conceptual framework that integrates AR with building information modeling (BIM) to detect construction defects. These applications demonstrate the potential of this technology for future use in this domain.
Although the application of augmented reality technologies in construction projects has tremendously increased in recent years, these technologies are still in the research stage and their full potential is not fully achieved. There are limitations that should be addressed before these technologies will become dominant in the AEC industry such as tracking technologies, and rendering software. Moreover, appropriate application areas for different types of AR will continue to evolve.
Historically, many AR technologies were not applied on construction sites due to tracking and alignment problems, instead they were generally used at the home office for simulation or collaboration during the design phase of a project. However as the technology developed in recent years, the majority of these technologies have been used on construction sites for progress monitoring and defect detection. Moreover, trend analysis shows that web-based and wireless network technologies are becoming more and more popular in recent years, and these types of AR technologies are interesting technologies for further research and application.
A list of various input mechanisms, output mechanisms, and tracking technologies for AR systems can be found in Wang (2009). Portable and mobile AR systems including: radio-frequency based tracking technologies such as GPS, WLAN, indoor GPS; infrastructure-dependent technologies such as fiducial markers; infrastructure-independent tracking technologies such as gyroscopes; and image-based tracking techniques have been studied in many research projects (Bae et al. 2013). Moreover, using cloud computing technologies for web-based and ubiquitous AR systems has been explored in recent years (Wang et al. 2013).
Shin et al. (2008) study various application areas for augmented reality technologies in industrial construction based on technology suitability. The research assesses different work tasks from the human factors perspective and presents a comprehensive map, which identifies eight work tasks including layout, excavation, positioning, inspection, coordination, supervision, commenting, and strategizing out of seventeen classified work tasks which could potentially benefit from AR systems.
Wang (2009) gives a detailed review of AR in the AEC industry, and gives a review of several major research efforts prior to 2009, and categorizes various AR technologies with their advantages and disadvantages.
Wang et al. (2013) reviews 120 articles published between 2005 and 2011 in various journal and conferences databases with a focus on augmented reality technologies in the built environment. The paper classifies all available toolkits for augmented reality prototyping in five categories: 2D marker AR-PC and web-cam based, 2D marker AR-mobile, 3D object recognition-mobile, marker-less tools, GPS-compass based AR. In their research, AR literature is classified in three categories: (1) application area; (2) AR system layers: concept and theory (with four sub-layers including: algorithm and modeling, conceptual framework, evaluation framework, and technology adoption), implementation (with two sub-layers: software and hardware), evaluation (with two sub-layers: effectiveness and usability), and industry adoption; (3) other technical criteria. The paper explores state-of-the-art technologies in each category and proposes future research directions.
Chi et al. (2013) discusses trends in AR applications for the AEC/FM with a specific focus on four AR technologies: localization, natural user interface, cloud computing, and mobile devices. The paper reviews 101 articles and outlines future trends and opportunities for applying AR in the AEC/FM industry in six directions: (a) field exploration based on hybrid localization, (b) in-field gesture or kinesthetic control of AR interface, (c) integration with location-specific information, (d) accessing field information using ubiquitous services, (e) portable AR devices in the field, (f) context-aware augmented reality in AEC/FM fields.
To apply AR technologies in AEC projects efficiently and to achieve their full potential in this domain, it is essential to systematically identify application areas in which AR can be used for better performance. This statistical review seeks to answer to these questions: what are key AR application areas in the AEC industry based on suitability of AR technologies? what are the gaps in this area which can potentially benefit from AR technologies? Based on future trends, predict how AR technologies can be further improved for future applications?
This paper presents an in-depth statistical literature review of augmented reality technologies in construction industry over a fourteen-year period (1999–2012). The goals of this review are (1) to synthesize the current state-of-the-art and trends of augmented reality technologies for construction projects, and (2) to identify key application areas which could significantly affect the construction industry. These goals are accomplished by classifying the literature in categories defined by the authors found in the literature.
The scientific contribution of this review is the presentation of a comprehensive multi-dimensional categorization for specifying AR technology and characteristics in the AEC industry. This literature review gives the researcher a broad view of the stage of AR technology maturity in built environment, which can be used to guide new augmented reality system design as well as to help evaluate existing systems for the construction industry.
This paper offers construction practitioners and researchers an assessment of the application areas of augmented reality technologies including the purposes for which these technologies have been applied in different project phases. The paper qualitatively aggregates the results of 133 research studies of AR technologies in construction projects to show researchers and practitioners how augmented reality models have been applied to address project challenges. Based on the trend analysis that is conducted, past research is studied and future research directions are recommended.
The research methodology used in this paper is illustrated in Figure 1: (A) to select the journals and articles, (B) to review the selected articles, (C) to define relevant categories to classify the articles, (D) to classify the articles in the defined categories. Step (B) and step (C) iterate until the final results are achieved. Step (E) is described in section 6 and section 7 which presents discussion and conclusion.
This paper is an extension of our conference paper (Rankouhi and Waugh 2012); the research methodology is similar to the methodology used previously. Five new journals are added to our database: the ASCE Journal of Computing in Civil Engineering (CCE), the Journals of Advanced Engineering Informatics (AEI), the Journal of Computer Aided Civil and Infrastructure Engineering (CACIE), the Emerald Journal of Engineering, Construction and Architectural Management (ECAM), and the Emerald Journal of Construction Innovation Information, Process, Management (CIIPM). These journals cover a wider range of database in civil engineering research domain, and increase the number of selected articles. In addition, five new dimensions (research methodology, improvement focus, industry sector, comparison role, and location) and various new categories are added to our previous defined dimensions.
Selection of the journals and articles
Eight diverse academic journals (listed in Table 1) were selected within the domain of AEC/FM to record the evolution of AR technology in the AEC industry. Selection of these journals is based on their prominence in the English language field of information technologies in construction engineering and management research.
The articles were selected in two phases. In phase I, a total of 199 articles were found in these eight journals using the search phrase “augmented reality.” In phase II, articles that were published in 2013 (due to the lack of a full year at the time when the search was conducted) and articles such as Calendars, Editors Notes, Subject Index, and Content of Volume were excluded. The total number of selected articles was reduced to 133. The number of articles found in each journal is listed in Table 1.
Review and identification of the article characteristics
This section describes statistics based on information provided by the authors, whereas the next section describes our interpreted categories. The number of articles by year and journal is depicted in Table 2.
The distribution of articles by journal and year of publication is depicted in Figure 2. The maximum number of articles in a single year is published in both 2011 and 2012 (26 articles or 20%). The data shows highest numbers of articles for individual years in the AIC (11 articles in 2011), the ITcon (10 articles in 2008), and the CCE (8 articles in 2012) journals. The results show that the increasing trend in the number of articles is dominated by AIC, AEI, and CCE in recent year. Eighty-five percent of the articles were published in the most recent five years.
The final characteristic identified in this section is the percentage of articles based on the first author’s country of residence which is shown in Figure 3. With 63 articles (47%), first authors residing in the USA have the highest number of the articles about AR technology in the AEC industry. The remaining counts show that Australia has the second place while both Canada and South Korea are in the third place.
Definition of categories
To better comprehend and further segregate the literature, we defined dimensions and categories to be used in this paper; each article was then compared to these defined dimensions for identification of its principal focus area or to determine the percentage of articles including reference to that classification. Table 3 shows the defined dimensions and the relevant categories. Each dimension is further explained in the following section.
Categorization of the articles
This section discusses the classification of the current state of AR technology literature in the AEC industry. For all but three sub-sections, the articles are classified based on their principal focus and each article is counted once. The exceptions to their approach are sub-sections 5.1, 5.4, and 5.8; in these sub-sections instead of selecting a single “principal focus,” we identified the categories to which the article “made reference.” In these three sub-sections only we report percentages and do not report counts.
In this section articles are classified based on their research methodology which is divided in five categories: case study, experimental/empirical study, proof of concept (or proof of principle study), questionnaire (survey/interview), and literature review.
A case study is a research method in which detailed consideration is given to the development of a particular case over a period of time. An experimental or empirical study is an empirical scientific method in which an experiment arbitrates between competing models or hypotheses. A proof of concept or a proof of principle study is a research method in which a certain method or model would be recognized to demonstrate its feasibility or to verify that a certain concept, theory, or prototype has the potential of being used. Questionnaires (as well as surveys and interviews) are research techniques in which qualitative and qualitative data analysis could be conducted based on the information gathered from research participants. Literature review (historical and documentary research, trend studies), is a research method which considers the critical points of current knowledge including substantive findings as well as theoretical and methodological contributions to a particular topic (Cohen et al. 2007).
Figure 4 depicts the percentages of articles based on their research method. Results show that large number of the articles use case studies to develop their research, while equal number of authors select an experimental method to conduct research in this area. Table 4, presents a list of selected reference articles for each category of research method dimension.
Articles are classified in four categories based on where the improvement which the article proposes would occur: (1) AEC industry, (2) organization, (3) projects, and (4) individuals. Moreover the organization category is divided into three subcategories of organization type including: (a) facility owner, (b) designer, and (c) contractor.
Figure 5 illustrates the number of articles within each improvement focus category. As shown, 69 articles (52%) have a principal focus on projects, while 27 articles (20%) have a principal focus on individuals in the construction industry. In addition, 19 articles (14%) and 12 articles (10%) have a principal focus on the AEC industry and the organization level, respectively.
In the construction industry various project types can benefit from AR technologies including: (1) municipal/infrastructure, e.g., evaluation of dynamic city models and an emission model for transportation (Aschwanden et al. 2012), (2) residential, e.g., virtual and augmented reality for designing and customizing mass housing (Duarte 2005), (3) building/commercial, e.g., visualizing high-rise building construction strategies (Russell et al. 2009), and virtual and augmented reality technologies for maintenance of exterior closures and interior finishes of walls and in the construction of buildings (Sampaio et al. 2012), (4) heavy/highway, e.g., developing virtual reality system for optimized simulation of road design data (Kang L. S. et al. 2010), and segmentation and recognition of highway assets using image-based 3D point clouds and semantic Texton forests (Golparvar-Fard et al. 2012), and (5) industrial, e.g., application areas for augmented reality in industrial construction (Shin and Dunston 2008).
Figure 6 presents the number of articles within each industry type category. As shown, 34 articles (26%) have a principal focus on building/commercial as an industry type for AR technology. Municipal/infrastructure, heavy/highway, industrial, and residential categories have 18 articles (14%), 14 articles (11%), 13 articles (10%) and 8 (6%) articles respectively. Thirty-six articles focus on multiple areas while these categories were not applicable for 10 articles. Table 5, presents a list of selected reference articles for each category of industry sector dimension.
Due to the complexity of construction projects and the collaborative nature of the AEC industry, the application of AR systems has a wide range of target audiences. To classify these articles the following audiences were chosen partially based on Muramoto et al. (2008): (1) worker, e.g., machine operators and technicians, (2) design team, e.g., architects, interior and exterior designers, (3) schedule and budget professional, in particular referred to as project manager, (4) building systems engineer, e.g., structural, mechanical, and electrical engineers, (5) inspector, e.g., project safety officers (6) engineering student, (7) project end user, e.g., building occupants, office employees, (8) other stakeholder, e.g., clients, and building owners. If an article proposed a change in, or enhancement of, the work of one of these audiences, it was classified in that category.
As noted above, in this section instead of giving the number of articles with a “principal focus on” a category, we report the percentage of articles “including reference to” that category, since in this section each article may refer to more than one category. Figure 7 presents the percentage of articles by target audience. The results indicate that the largest number of articles include reference to workers as the target audience. A list of selected reference articles for each category of target audience dimension is shown in Table 6.
The life cycle of a construction project consists of a sequence of steps or project phases to be completed in order to reach project goals and objectives. These phases are defined by N. Dawood (2009) as: (1) initiation and outline design, (2) design development, (3) [procurement], contract and pre-construction, (4) construction, and (5) maintenance. The number of the articles by project phase is depicted in Figure 8. A list of selected reference articles for each category of project phase dimension is shown in Table 7.
Figure 9 illustrates the number of articles for each project phase by year of publication. In this diagram articles with a focus on multiple phases are excluded (reducing the total to 98 articles). The highest number of articles in a single year is for the construction phase in the year 2012. The focus on the design phase of a project reached its highest number (5 articles) in the year 2008. Figures 8 and 9 show that the highest number of articles occur in the construction phase of a project for AR technologies and applications.
Stage of technology maturity
From a stage of technology maturity perspective, the articles are divided into five categories: (1) theory, (2) framework, (3) sub-system technical issues, e.g., investigation of tracking, positioning and orienting issues for AR-based technology for steel column inspection (Shin and Dunston 2010), (4) proposed system development, e.g., development of ARVISCOPE (AR animation scripting language) and ROVER a mobile computing framework for information modeling and simulation of construction operation (Behzadan et al. 2011), and (5) system application demonstration and production, e.g., application of D4AR for construction progress monitoring (Golparvar-Fard et al. 2011a), application of AR Training System for training the operation of heavy construction equipment (Wang et al. 2007).
Figure 10 illustrates the number of articles within each stage-of-technology-maturity category. Results also show that only four articles (3%) have a principal focus on AR theory, while six articles (5%) have a focus on multiple areas (i.e., more than one of the previous stages); these multiple areas are typically a combination of application demonstration and proposed system development. A list of selected reference articles for each category of stage of technology maturity dimension is shown in Table 8.
Augmented reality technology has many applications in the AEC industry. We classify AR application areas in the AEC industry as follows: (1) visualization or simulation, (2) communication or collaboration, (3) information modeling, (4) information access or evaluation, (5) progress monitoring, (6) education or training, and (7) safety or inspection.
Figure 11 presents application areas for AR technologies in the AEC industry. As shown, 26 articles (20%) have a principal focus on visualization and simulation as an application area for AR technology. Thirteen articles focus on multiple application areas, while these subcategories were not applicable for 8 articles. A list of selected reference articles for each category of AR application area dimension is shown in Table 9.
Construction participants use augmented reality technologies to compare different statuses of a project. Articles that “make reference” to the comparison role of AR technologies are divided in two categories; (1) comparison modes: (a) reality versus reality, e.g., comparing two construction site 360 degree panoramas at two different times for virtual reality documentation of Inuvik Super School (Waugh et al. 2012), (b) model versus reality, e.g., integrating sequential as-built and as-planned representation with D4AR tools (Golparvar-Fard et al. 2011a), and (c) model versus model, e.g., the application of Experimental Virtual Environment (EVE) (Savioja et al. 2003); and (2) comparison purpose, e.g., progress monitoring, defect detection, validating the model, updating the model, and evaluating the model.
Sixty-two articles (47% of articles) have reference to the comparison role of augmented reality technologies in construction industry. For these 62 articles only, Figure 12 illustrates the number and the percentage of articles within each comparison mode category. A list of selected reference articles for each category of comparison mode dimension is shown in Table 10.
Figure 13 depicts the percentage of articles within each comparison purpose category for these 62 articles. As shown, 32% refer to comparison for progress monitoring, 28% for defect detection, 16% for evaluating the model, 13% for updating the model, and 11% for validating the model. A list of selected reference articles for each category of comparison purpose dimension is shown in Table 11.
Augmented reality technology, which typically layers virtual information on a real scene, utilizes different hardware (personal computers (PC), laptops, head mounted displays (HMD), GPS, data gloves, smart boards, etc.) and software (AutoCAD, Photoshop, AC3D, 3D Studio, building information model (BIM), etc.). From a technology perspective articles are classified into three categories: (1) user experience: (a) immersive or (b) non-immersive, i.e., desktop-based; (2) device: (a) mobile, (b) stationary or non-mobile; (3) delivery: (a) web-based, (b) standalone.
Devices such as HMD and data-gloves create immersive AR systems, in which users feel immersed in a virtual environment just as they usually feel in a real environment. Due to the improving performance of handheld devices and recent solutions to technical difficulties such as tracking, there is an opportunity for augmented reality systems to become portable, as well there is a growing interest in the use of mobile AR applications. Web-based augmented reality technologies can deliver project information to remote locations and are very useful to manage virtual projects around the globe. Finally, due to the wide range of AR applications, these technologies can be used both on-site for progress monitoring and in an office (not-on-site) for design control.
From the user experience perspective, 32 articles have a principal focus on immersive AR technologies, 76 articles (57%) have a principal focus on non-immersive or desktop-based AR technologies, while 25 articles were not applicable. Figure 14 presents the number of articles with immersive and non-immersive technologies as a principal focus by year.
Figure 15 presents the number of articles within the device category that had a principal focus on mobile and non-mobile AR technologies in the AEC industry. The diagram implies an increasing trend in mobile AR technologies in AEC industry. Of the selected articles, one was published in 2000 that discussed mobile AR technology; while 7 articles (5%) focus on mobile AR technologies in both year 2011 and year 2012; 41 articles were not applicable to this category.
Figure 16 depicts the number of articles within the delivery category that had a principal focus on web-based and on standalone AR technologies in the AEC industry. Fifty-two articles (40%) were not applicable to this category. A list of selected reference articles for each category of technology dimension is shown in Table 12.
Augmented reality technologies can be applied in different locations during a construction project. From a location perspective, AR technologies can be classified in two categories: (a) field, e.g., using robot-aided tunnel inspection and maintenance system on construction site (Victores et al. 2011), (b) home office, e.g., virtual environments for synchronous and remote collaborative design (Germani et al. 2012).
Figure 17 depicts the number of articles within the technology category that had a principal focus of on-site and on not-on-site. The diagram implies an increasing trend in the on-site application of AR technologies in construction projects. The highest number of articles in a single year is for the on-site technologies in the year 2012. Twenty-two articles (17%) were not applicable to this category. A list of selected reference articles for each category of location dimension is shown in Table 13.
Figure 18 shows the total number of articles in defined dimensions and categories, in which increasing trends over the period are indicated by an up arrow and dominant categories are indicated by bold font.
The following results are concluded for the categories defined in this research.
Journals: Automation in construction has the highest overall number of articles among the journals. The maximum number of AR technology articles published in these eight journals in a single year, occurred both in 2011 and 2012. Eighty-three percent of the articles were published in most recent five years.
First authors: USA, with more than half of articles, is the dominant residence of the first authors.
Research methodology: Case studies and experimental studies with 32% and 31% respectively, are the most frequent research method among selected articles.
Improvement focus: The majority of the articles focus on projects rather than on the AEC industry, organization or individual level.
Industry sector: building/commercial with 35% have the highest number of articles, whereas, residential have the least number of articles.
Target audience: The most frequent focus is the workers (e.g., machine operators and technicians), whereas the least focus is on project end users.
Project phase: The most frequent focus is the construction phase with the maintenance phase being next with approximately half as many articles. Twenty-six articles cover two phases (e.g., initiation/design) or all phases. Procurement phase shows a lack of focus in the area of AR systems.
Stage of technology maturity: The most number of articles focus on AR system application rather than system development or sub-system technical issues.
Application areas: Approximately half of the articles had a principal focus on visualization/simulation or communication/collaboration, and just a few articles focus on education/training and safety/inspection.
Comparison role: 47% of the articles made reference to the comparison role of augmented reality technologies for comparing different statuses of projects. More than half of those articles focused on comparing a model with a reality to monitor progress and detect construction defects. Comparing model vs. model captured the least attention in this area. In addition, majority (%60) of the comparison articles focus on field audience (for progress monitoring and defect detection), while less than half of the comparison articles focus on home office audience (for model improvement).
Hardware system: From the user-experience perspective most of the articles discussed non-immersive technologies. From the delivery perspective, most of the articles discussed standalone technologies, and from device perspective, most of the articles focus on non-mobile technologies. A spike in the number of articles focusing on mobile technologies occurred in 2011.
Location: The most frequent focus is AR technologies which can be applied in the field (rather than in the home-office). The field category included almost 80% of those articles which referred to a location.
Table 14 provides a list of the categories for which there was a significant and consistently-increasing trend in the most recent five years. There were no categories for which the number of articles was consistently-decreasing over the 14 year period.
AR technologies provide proven benefits especially in the areas of visualization/simulation and communication/collaboration, however these benefits are not yet widely adopted by AEC industry participants nor have they been incorporated into industry-wide workflow processes. As a result, industry participants choose to pilot (i.e., system development and application) AR technologies on a few projects rather than adopting or piloting the technology across their organization.
Building/commercial projects provide a good test bed for visualization and communication of different perspectives of a project, since these projects typically entail more complexity and more need for integration than an infrastructure, heavy/highway, or residential projects. However, the trend in the most recent five years shows that heavy/highway projects are getting an area of focus for new AR technologies. We also predict that use on industrial projects will grow rapidly as technologies are improved and confidence is gained.
We predict expansion of AR technologies from a principal role in the construction and maintenance phases to other phases (especially the design and procurement phases) as the ability to compare virtual models with previous virtual models (and realities with previous realities) to monitor project progress and detect construction defections, rather than the narrow focus of comparing a current construction phase reality with a final design phase model.
The uniform distribution of target audiences among the design team, the project management team, and on-site personnel reflects integration being the essential purpose of AR technologies.
We predict continued growth in the use of internet and web-based devices to enhance integration of perspectives. Collaborative, ubiquitous, and internet-based AR systems enable users to update and synchronize the information from a remote location. Cloud computing technologies could help next generation construction professionals to access massive amount of field information such as BIM rapidly and conveniently (Chi et al. 2013).
We also predict continued growth in the use of mobile and portable multi-user AR devices to display (and capture) models and realities. The next generation mobile technologies are likely to have natural user interface (Wang et al. 2013), which would be controlled by human movement and gestures, and makes it easy for field workers to use AR systems on construction sites. It is also predicted that next generation mobile AR systems would have context-aware and location-aware applications. We also speculate that the cost of immersive hardware is, and will continue to be, an impediment to its widespread use.
A structured methodology was used to identify 133 articles on the topic of augmented reality from eight prominent AEC industry journals. The first article was published in 1999; a significant increase in the number of articles on this topic occurred during the year 2008. In addition to statistics on the counts of articles by year and the first author’s country of residence, ten interpreted dimensions were developed for classification of these articles. Literature show field workers and project managers have high interests in using non-immersive and desk-top standalone (individual) AR technologies during construction phase of a project to compare as-planned versus as-built statuses to monitor progress and defect detection. Whereas, it is predicted that future trend, is more toward using collaborative and internet based mobile AR systems which have applications not only in construction phase, but also in procurement and maintenance phases of a project. Due to various benefits of AR technology for construction industry, the application of AR systems for initiation and procurement phase of a project to compare model vs. model and reality vs. reality is recommended. Moreover, lightweight mobile and immersive AR systems are also recommended for field personnel due to dynamic environment of construction fields.
Based on this review, our recommendation for researchers in the area of AR technology is that the current trial systems should have narrow applications and there is an essential need for more comprehensive systems. There is an opportunity for more research on the application of AR systems during the procurement phase of construction projects, since literature shows a lack of research in these phases of project. In addition, the assessment of success of developed systems should be validated by researcher and practitioner from academy and industry. From a theory and framework perspective, integration of multiple projects (within an organization) and integration of multiple organizations (within the industry) could be a considered for future research in the area of AR systems. Integration might be easier in less complex types of work, i.e., residential projects. Comparisons are fundamental to AR system within the AEC industry to be able to monitor projects and defect detections, therefore, our testing of five comparison purposes (progress monitoring, defect detection, evaluating the model, updating the model, validating the model) need to be further investigated.
We assume that construction industry practitioners would assess an AR system based on the system contents, features, and value. From the content perspective they would seek current (possibly real-time) information as well as a historical record that may be integrated with traditional project information (e.g., BIM). From a feature perspective, they would seek a user friendly interface (possibly internet-based) that can be integrated into their content workflow process and that facilitate the comparison of project statuses over time. From the value perspective, they would seek an affordable cost (initial and ongoing) for which the payback period is short. We assume the benefits of AR contribute to this payback are virtual site visits, defect detection, pre-empting dispute resolution, photographic as-built, and training of personnel. Currently, most of systems found in the literature are trial/demonstration, hence they are developed for specific purposes they do not have all of the above criteria, however some new systems offers some valuable feature and may provide a competitive advantages. As the technology is rapidly evolving, it is recommended to the construction participants to monitor this developing area closely in order to get the latest update.
Ajam M, Alshawi M, Mezher T: Augmented process model for e-tendering: towards integrating object models with document management systems. Journal of Automation in Construction, Elsevier 2010, 19: 762–778. 10.1016/j.autcon.2010.04.001
Akhavian R, Behzadan AH: An integrated data collection and analysis framework for remote monitoring and planning of construction operations. Journal of Advanced Engineering Informatics, Elsevier 2012, 26: 749–761. 10.1016/j.aei.2012.04.004
Aschwanden GDPA, Wullschleger T, Müller H, Schmitt G: Agent based evaluation of dynamic city models: a combination of human decision processes and an emission model for transportation based on acceleration and instantaneous speed. Journal of Automation in Construction, Elsevier 2012, 22: 81–89.
Bae H, Golparvar-Fard M, White J: Enhanced HD4AR (Hybrid 4-Dimensional Augmented Reality) for Ubiquitous Context-aware AEC/FM Applications, CONVR 2012, 12th International Conference on Construction Applications of Virtual Reality. Taipei, Taiwan: National Taiwan University; 2012.
Bae V, Golparvar-Fard M, White J: High-precision vision-based mobile augmented reality system for context-aware architectural, engineering, construction and facility management (AEC/FM) applications. Visualization in Engineering 2013, 1–3.
Behzadan AH, Kamat VR: Automated generation of operations level construction animations in outdoor augmented reality. ASCE Journal of Computing in Civil Engineering, ASCE 2008, 23: 405–417.
Behzadan AH, Kamat VR: Integrated information modeling and visual simulation of engineering operations using dynamic augmented reality scene graphs. Journal of Information Technology in Construction, ITcon 2011, 16: 259–278.
Bohn JS, Jochen T: Benefits and barriers of construction project monitoring using high-resolution automated cameras. ASCE Journal of Construction Engineering and Management, ASCE 2009, 25: 66–74.
Brilakis I, Fathi H, Rashidi A: Progressive 3D reconstruction of infrastructure with videogrammetry. Journal of Automation in Construction, Elsevier 2011, 20: 884–895. 10.1016/j.autcon.2011.03.005
Chi HL, Chen YC, Kang SC, Hsieh SH: Development of user interface for tele-operated cranes. Journal of Advanced Engineering Informatics, Elsevier 2012, 26: 641–652. 10.1016/j.aei.2012.05.001
Chi HL, Kang SC, Wang X: Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Journal of Automation in Construction, Elsevier 2013, 33: 116–122.
Cohen L, Manion L, Morrison K: Research methods in education. Sixth Edition edition. Abingdon, Oxon OX14 4RN: Routledge-Taylor and Francis e-Library; 2007.
Dai F, Lu M, Kamat VR: Analytical approach to augmenting site photos with 3D graphics of underground infrastructure in construction engineering applications. ASCE Journal of Computing in Civil Engineering, ASCE 2011, 25: 66–74. 10.1061/(ASCE)CP.1943-5487.0000072
Dawood N: VR-Roadmap: a vision for 2030 in the built environment. Journal of Information Technology in Construction, ITcon 2009, 14: 489–506.
Dong S, Kamat VR: SMART: scalable and modular augmented reality template for rapid development of engineering visualization applications. Visualization in Engineering 2013, 1–1.
Duarte PJ: A discursive grammar for customizing mass housing: the case of Siza’s houses at Malagueira. Journal of Automation in Construction, Elsevier 2005, 14: 265–275. 10.1016/j.autcon.2004.07.013
Dunston PS, Wang X: Mixed reality-based visualization interfaces for architecture, engineering, and construction industry. ASCE Journal of Construction Engineering and Management, ASCE 2005,131(12):1301–1309. 10.1061/(ASCE)0733-9364(2005)131:12(1301)
Dunston PS, Wang X: An iterative methodology for mapping mixed reality technologies to AEC operations. Journal of Information Technology in Construction, ITcon 2011, 16: 509–528.
Esch G, Scott MH, Zhang E: Graphical 3D visualization of highway bridge ratings. ASCE Journal of Computing in Civil Engineering, ASCE 2009, 23: 355–362. 10.1061/(ASCE)0887-3801(2009)23:6(355)
Fathi H, Brilakis I: Automated sparse 3D point cloud generation of infrastructure using its distinctive visual features. Journal of Advanced Engineering Informatics,.Elsevier 2011, 25: 760–770. 10.1016/j.aei.2011.06.001
German S, Brilakis I, DesRoches R: Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments. Journal of Advanced Engineering Informatics, Elsevier 2012, 26: 846–858. 10.1016/j.aei.2012.06.005
Germani M, Mengoni M, Peruzzini M: An approach to assessing virtual environments for synchronous and remote collaborative design. Journal of Advanced Engineering Informatics, Elsevier 2012, 26: 793–813. 10.1016/j.aei.2012.06.003
Golparvar-Fard M, Peña-Mora F, Savarese S: D4AR – A 4-dimensional augmented reality model for automating construction progress monitoring, data collection, processing and communication. Journal of Information Technology in Construction, ITcon 2009, 14: 129–153.
Golparvar-Fard M, Bohnb J, Teizerb T, Savaresec S, Peña-Mora F: Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring. Journal of Automation in Construction, Elsevier 2011, 20: 1143–1155. 10.1016/j.autcon.2011.04.016
Golparvar-Fard M, Peña-Mora F, Savarese S: Integrated sequential as-built and as-planned representation with D4AR tools in support of decision-making tasks in the AEC/FM industry. ASCE Journal of Construction Engineering and Management, ASCE 2011,137(12):1099–1116. 10.1061/(ASCE)CO.1943-7862.0000371
Golparvar-Fard M, Balali V, De la Garza JM: Segmentation and recognition of highway assets using image-based 3D point clouds and semantic Texton forests. ASCE Journal of Computing in Civil Engineering 2012, 1943–5487. 10.1061/(ASCE)CP.1943-5487.0000283
Gu N, Kim MJ, Maher ML: Technological advancements in synchronous collaboration: The effect of 3D virtual worlds and tangible user interfaces on architectural design. Journal of Automation in Construction, Elsevier 2011, 20: 270–278. 10.1016/j.autcon.2010.10.004
Gül LF, Gu N, Williams A: Virtual worlds as a constructivist learning platform: evaluations of 3d virtual worlds on design teaching and learning. Journal of Information Technology in Construction, ITcon 2008, 13: 578–593.
Hammad A, Wang H, Mudu SP: Distributed augmented reality for visualizing collaborative construction tasks. ASCE Journal of Computing in Civil Engineering, ASCE 2009, 23: 418–427. 10.1061/(ASCE)0887-3801(2009)23:6(418)
Huang S, Yang Y, Chu C: Human-centric design personalization of 3D glasses frame in marker less augmented reality. Journal of Advanced Engineering Informatics, Elsevier 2012, 26: 35–45. 10.1016/j.aei.2011.07.008
Isikdag U, Underwood J: Two design patterns for facilitating building information model-based synchronous collaboration. Journal of Automation in Construction, Elsevier 2010, 19: 544–553. 10.1016/j.autcon.2009.11.006
Jang W, Healy W, Skibniewski M: Wireless sensor networks as part of a web-based building environmental monitoring system. Journal of Automation in Construction, Elsevier 2008, 17: 729–736. 10.1016/j.autcon.2008.02.001
Jardón A, Victores JG, Martínez S, Balaguer C: Experience acquisition simulator for operating microtuneling boring machines. Journal of Automation in Construction, Elsevier 2012, 23: 33–46.
Kamat VR, Martinez JC, Fischer M, Golparvar-Fard M, Peña-Mora F, Savarese S: Research in visualization techniques for field construction. ASCE Journal of Construction Engineering and Management, ASCE 2011,137(10):853–862. 10.1061/(ASCE)CO.1943-7862.0000262
Kang LS, Moon HS, Dawood N, Kang MS: Development of methodology and virtual system for optimised simulation of road design data. Journal of Automation in Construction, Elsevier 2010, 19: 1000–1015. 10.1016/j.autcon.2010.09.001
Khoury HM, Kamat VR: Evaluation of position tracking technologies for user localization in indoor construction environments. Journal of Automation in Construction, Elsevier 2009, 18: 444–457. 10.1016/j.autcon.2008.10.011
Kuo CH, Tsai MT, Kang SC: A framework of information visualization for multi-system construction. Journal of Automation in Construction, Elsevier 2011, 20: 247–262. 10.1016/j.autcon.2010.10.003
Lee S, Akin O: Augmented reality-based computational fieldwork support for equipment operations and maintenance. Journal of Automation in Construction, Elsevier 2011, 20: 338–352. 10.1016/j.autcon.2010.11.004
Leicht RM, Messner JI, Anumba CJ: A framework for using interactive workspaces for effective collaboration. Journal of Information Technology in Construction, ITcon 2009, 14: 180–203.
Li Y, Liu C: Integrating field data and 3D simulation for tower crane activity monitoring and alarming. Journal of Automation in Construction, Elsevier 2012, 27: 111–119.
Liang X, Lu M, Zhang JP: On-site visualization of building component erection enabled by integration of four-dimensional modeling and automated surveying. Journal of Automation in Construction, Elsevier 2011, 20: 236–246. 10.1016/j.autcon.2010.10.002
Lucas J, Thabet W: Implementation and evaluation of a VR task-based training tool for conveyor belt safety training. Journal of Information Technology in Construction, ITcon 2008, 13: 637–659.
Malkawi AM: Developments in environmental performance simulation. Journal of Automation in Construction, Elsevier 2004, 13: 437–445. 10.1016/j.autcon.2004.03.002
Muramoto K, Jemtrud M, Kumar S, Balakrishnan B, Wiley D: Emerging technology in tele-collaborative design studio between Pennsylvania State University and Carleton University. Journal of Information Technology in Construction, ITcon 2008, 13: 660–673.
Park C, Lee DY, Kwon OS, Wang X: A framework for proactive construction defect management using BIM, augmented reality and ontology-based data collection template. Journal of Automation in Construction, Elsevier 2013, 33: 61–71.
Peña-Mora F, Thomas JK, Golparvar-Fard M, Aziz Z: Supporting civil engineers during disaster response and recovery using a Segway mobile workstation Chariot. ASCE Journal of Computing in Civil Engineering, ASCE 2012, 26: 448–455. 10.1061/(ASCE)CP.1943-5487.0000117
Rankouhi S, Waugh LM CONVR 2012, 12th International Conference on Construction Applications of Virtual Reality. In Augmented reality technologies for AEC projects: a literature review. Taipei, Taiwan: National Taiwan University; 2012.
Roh S, Aziz Z, Peña-Mora F: An object-based 3D walk-through model for interior construction progress monitoring. Journal of Automation in Construction, Elsevier 2011, 20: 66–75. 10.1016/j.autcon.2010.07.003
Russell A, Staub-French S, Tran N, Wong W: Visualizing high-rise building construction strategies using linear scheduling and 4D CAD. Journal of Automation in Construction, Elsevier 2009, 18: 219–236. 10.1016/j.autcon.2008.08.001
Sampaio AZ, Gomes AR, Santos JP: Management of building supported on virtual interactive models: construction planning and preventive maintenance. Journal of Information Technology in Construction, ITcon 2012, 17: 121–133.
Savioja L, Mantere M, Olli L, Äyräväinen S, Gröhn M, Iso-Aho J: Utilizing virtual environments in construction projects. Journal of Information Technology in Construction, ITcon 2003, 8: 85–99.
Shin DH, Dunston PS: Identification of application areas for Augmented Reality in industrial construction based on technology suitability. Journal of Automation in Construction, Elsevier 2008, 17: 882–894. 10.1016/j.autcon.2008.02.012
Shin DH, Dunston PS: Evaluation of augmented reality in steel column inspection. Journal of Automation in Construction, Elsevier 2009, 18: 118–129. 10.1016/j.autcon.2008.05.007
Shin DH, Dunston PS: Technology development needs for advancing augmented reality-based inspection. Journal of Automation in Construction, Elsevier 2010, 19: 69–182.
Styliadis AD: Historical photography-based computer-aided architectural design: demolished buildings information modeling with reverse engineering functionality. Journal of Automation in Construction, Elsevier 2008, 18: 51–69. 10.1016/j.autcon.2008.04.010
Sutherland I: A Head-Mounted Three Dimensional Display, Proc. Fall Joint Computer Conference 1968. Washington, DC: Thompson Books; 1968:757–764.
Turkan Y, Bosche F, Haas CT, Haas R: Automated progress tracking using 4D schedule and 3D sensing technologies. Journal of Automation in Construction, Elsevier 2012, 22: 414–421.
Victores JG, Martínez S, Jardón A, Balaguer C: Robot-aided tunnel inspection and maintenance system by vision and proximity sensor integration. Journal of Automation in Construction, Elsevier 2011, 20: 629–636. 10.1016/j.autcon.2010.12.005
Wang X: Augmented reality in architecture and design: potentials and challenges for application. International Journal of Architectural Computing 2009,7(2):309–326. 10.1260/147807709788921985
Wang X, Dunston PS: Compatibility issues in augmented reality systems for AEC: an experimental prototype study. Journal of Automation in Construction, Elsevier 2006, 15: 314–326. 10.1016/j.autcon.2005.06.002
Wang X, Dunston P: Design, strategies, and issues towards an augmented reality-based construction training platform. Journal of Information Technology in Construction, ITcon 2007, 12: 363–380.
Wang X, Dunston PS: User perspectives on mixed reality tabletop visualization for face-to-face collaborative design review. Journal of Automation in Construction, Elsevier 2008, 17: 399–412. 10.1016/j.autcon.2007.07.002
Wang X, Gu N, Marchant D: An empirical study on Designers’ perceptions of augmented reality with in an architectural firm. Journal of Information Technology in Construction, ITcon 2008, 13: 536–552.
Wang K, Hou Z, Gong W: Automated road sign inventory system based on stereo vision and tracking. Journal of Computer-Aided Civil and Infrastructure Engineering 2010, 25: 468–477. 10.1111/j.1467-8667.2010.00657.x
Wang C, Cho YK, Gai M: As-is 3D thermal modeling for existing building envelopes using a hybrid LIDAR system. ASCE Journal of Computing in Civil Engineering, ASCE 2012. 1943–5487 1943–5487 10.1061/(ASCE)CP.1943-5487.0000273
Wang X, Kim MJ, Love PED, Kang SC: Augmented reality in built environment: classification and implications for future research. Journal of Automation in Construction, Elsevier 2013, 32: 1–13.
Waugh LM, Rausch B, Engram T, Aziz F: Inuvik Super School VR Documentation: Mid-Project Status. Quebec, Canada: CSCE, 15th International Conference on Cold Regions Engineering; 2012. August 19–22 August 19–22
Yabuki N, Miyashita K, Fukuda T: An invisible height evaluation system for building height regulation to preserve good landscapes using augmented reality. Journal of Automation in Construction, Elsevier 2011, 20: 228–235. 10.1016/j.autcon.2010.08.003
Zhu Z, Brilakis I: Parameter optimization for automated concrete detection in image data. Journal of Automation in Construction, Elsevier 2010, 19: 944–953. 10.1016/j.autcon.2010.06.008
Zhu Z, German S, Brilakis I: Visual retrieval of concrete crack properties for automated post-earthquake structural safety evaluation. Journal of Automation in Construction, Elsevier 2012, 20: 874–883.
The authors declare that they have no competing interests.
Both authors contributed extensively to the work presented in this paper. SR searched the databases, selected the articles, reviewed and analyzed the literature, and prepared the manuscript. LW defined dimensions and categories, supervised the overall review, and edited the manuscript. Both authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.