Assignment 4 - Design of Interface Application: Maintenance and Repairs

Elevator Pitch:

Do you get sick and tired of feeling helpless whenever your car malfunctions or requires servicing? Imagine having a reliable mechanic always at your fingertips. Let us introduce you to our revolutionary augmented reality (AR) vehicle assistant!

Use our augmented reality app to:

Use your phone or webcam to instantly recognise auto parts.

Get in-depth, interactive how-to's for fixing or maintaining anything.

Experts can identify issues and offer assistance using only straightforward language.

Protect yourself and others with timely alerts and safety checks.

Find out what the car's computer is trying to tell you and how to fix it if it gives you an error message.

Get help from both amateur mechanics and experienced pros by joining a thriving online community.

Our augmented reality app can make even the most inexperienced motorist feel at ease by providing instant access to the advice of industry professionals. There will be no more guesswork or frustration, just calm sailing and relaxation. Now is the time to take charge of your vehicle's health by using our augmented reality Vehicle Maintenance Assistant.

Maintenance and repairs:

Maintaining a vehicle can be difficult, and many people find it difficult and/or frustrating to fix their own vehicles. The complexity of modern automobile engines makes it difficult for consumers to do routine maintenance, let alone diagnose and repair mechanical failures. This can be especially troublesome in areas with sparse options for automotive maintenance.

Our solution is an augmented reality (AR) program that, when a user points their smartphone or webcam at the automobile engine, overlays instructions and animations to help them do routine maintenance or diagnose problems on their motor vehicles. 

The project focuses on creating automotive maintenance and repair software using Augmented Reality (AR). The complexity of car maintenance is a worldwide issue, and our project aims to simplify things for people who don't have a background in auto repair.  The augmented reality application can tell you what each section of the car's engine and other components are by looking at a picture. When a user points their smartphone or webcam at the engine, the program immediately locates and classifies the various components. Users of the app are helped through these processes like oil changes, filter swaps, and fluid level checks with the use of graphics and written explanations. 

Figure 1 - Storyboard

Here is a more in-depth look at the functionality of the program:

Visual Recognition:

Upon initiating the augmented reality (AR) application on their mobile device or computer, users have the capability to engage the visual recognition functionality. By utilising the camera of the device, the application does a real-time scanning of the engine and its adjacent components of the automobile.

The application utilises strong picture recognition software to accurately detect and classify different components, including but not limited to the battery, oil filter, air intake, and ignition system. After being discovered, the application superimposes labels onto these components within the user's visual perception. As an illustration, the oil filter may be assigned a virtual tag "Oil Filter".

Step-by-Step Guides:

Upon the user's selection of a particular maintenance task or interaction with a labelled component, the application grants access to a comprehensive, chronological instructional manual for this task. The instructional guide incorporates written directions, visual representations in the form of graphical imagery, and video links to effectively demonstrate each sequential procedure. The guide allows for user engagement through the utilisation of swiping or touching gestures to navigate between individual steps. For example, when the user chooses the "Change Oil" option, the application will provide step-by-step instructions on how to perform the task, starting from identifying the oil drain plug and concluding with securing the oil filter.

The application has potential for a higher level of development, with possible features such as: 

Diagnostic Assistance:

The application can also be utilised by users for rudimentary diagnosis of car issues. The individuals have the ability to articulate the issue they are encountering, for instance, the occurrence of a rattling noise emanating from the engine. The application uses natural language processing techniques to examine the description and propose potential problems based on the user's input. In the event that the user's issue aligns with a frequently encountered problem, the application offers guidance in visually examining and exploring the issue.

Parts and Tools Information:

The application provides a comprehensive inventory of necessary tools and replacement components for any maintenance activity. Individuals have the ability to access and examine a comprehensive inventory, enabling them to mark off the tools and components they possess. This feature streamlines the process of procuring the necessary equipment for a repair or maintenance undertaking.

Safety Precautions:

In order to ensure the safety of individuals, it is imperative to implement appropriate safety precautions. The prioritisation of safety is of utmost importance in the context of vehicle maintenance, a principle that is reinforced through the application. Throughout each stage of the maintenance or repair procedure, the application offers safety reminders and safeguards. The reminders include guidelines relevant to the utilisation of particular safety equipment, proper techniques for raising the car in a safe manner, and the disconnection of the battery as required.(NiDirect, 2023) Prior to going to the subsequent stage, it is imperative for users to accept and take into consideration these safety alerts.

Troubleshooting and Error Codes:

In the realm of technical problem-solving, the process of troubleshooting and the use of error codes play a crucial role. The application incorporates a functionality designed to diagnose intricate problems that have the potential for triggering fault codes within the electronic systems of the car. Individuals have the ability to establish a connection between their application and the automobile's OBD-II (On-Board Diagnostics) system by utilising an ODB-II connector and either Bluetooth or Wi-Fi technology, thereby enabling them to retrieve error codes from the system.(Petersons, 2023) The application offers explanations for these codes and suggests possible remedies or recommended courses of action. In addition, users have the capability to access past error codes in order to effectively monitor and track reoccurring issues.

Community Support:

In order to provide further support to users, the application integrates a community support feature. Individuals have the opportunity to engage in discussions and seek assistance through a forum or chat support platform, where they can interact with fellow do-it-yourself (DIY) mechanics or professionals in the field. Consumers have the opportunity to solicit guidance, exchange unique stories, and submit enquiries in the event that they encounter problems or have particular questions. The presence of community support in this context cultivates a cooperative atmosphere for individuals interested in automobiles and those other consumers seeking to further their knowledge in the field of car maintenance, bridging the gap between the two. 

The primary features of the AR application are comprised of these components, which collectively offer users extensive guidance, help, and resources for conducting car maintenance and repairs. The techniques employed by the system are designed to be user-friendly, instructive, and interactive. Its objective is to empower users, including those with less automotive experience, to effectively address a range of tasks and successfully maintain their vehicles in a safe and appropriate manner.

The benefits of using the application:

Empowering Users: The application provides users with less automotive knowledge the ability to assume responsibility for their vehicle's upkeep, so empowering them. This technology serves as a mediator between intricate automotive systems and the general populace, empowering individuals to undertake jobs that they may have otherwise delegated to professional mechanics, so instilling them with a sense of self-assurance.

Cost Savings: The application has the potential to substantially decrease individuals' dependence on professional mechanics for routine services by empowering users to independently perform basic maintenance activities. This phenomenon results in significant long-term cost reductions, hence enhancing the affordability of owning an automobile.

Improved Vehicle Maintenance: By adhering to prescribed maintenance protocols, individuals can effectively uphold the optimal condition of their automobiles. The use of routine maintenance practises has been found to result in enhanced fuel efficiency, extended lifespan of vehicle components, and a decreased probability of incurring expensive breakdowns.

Safety Assurance: Ensuring safety is of utmost importance when engaging in vehicle-related tasks,(NiDirect, 2023) and the application places significant emphasis on this aspect by offering timely safety reminders and safeguards during the process. Users may confidently carry out maintenance chores, as they are aware of and implementing the necessary safety precautions.

Accessibility: The application demonstrates a high level of accessibility, accommodating users with diverse levels of automobile knowledge. The system simplifies intricate operations into a series of straightforward instructions, giving car maintenance accessibility to individuals of all backgrounds, irrespective of their prior expertise.

Community Engagement: The application facilitates the development of a communal atmosphere among those who possess a keen interest in automobiles and engage in do-it-yourself mechanical work. Individuals have the opportunity to solicit guidance, exchange personal anecdotes, and acquire knowledge from their peers, fostering a nurturing atmosphere that promotes educational growth and cooperative engagement.

Convenience: Users are able to access the application from several locations, including their garage, when travelling, or when seeking assistance from the community. The presence of a virtual mechanic accessible at all times provides a sense of convenience and assurance.

The difficulties in development of the application:

Visual Recognition Accuracy: Image recognition of car components is a major challenge. Engine layouts and parts vary by automobile make and model, making vehicle identification difficult.

Vehicle Manufacturers and Models: Design and components differ widely among vehicles. Content production and support for many makes and models with different maintenance requirements is difficult.

Complex Maintenance: While the app can help with basic maintenance, some difficulties may require specialised expertise and resources. Set explicit expectations and limitations to avoid users from doing things above their skills, which could cause more problems.

Safety Concerns: Users must be reminded and urged to take safety precautions. Ensuring users understand and follow safety measures can be difficult, especially for those who may miss them.

Advanced technology, user education, robust content development, and user feedback and assistance are needed to overcome these problems. A dedicated and disciplinary team of engineers, automotive experts, and user experience designers is needed to develop and implement such an app.

Other than text and potential small animations, no 3D models will be required for the end product of the application as it is primarily text and video based. The software chosen for the development of the application is Unity, using the Vuforia engine for the AR component of the application. This was chosen due to the ease of use and simple nature of the software. This augmented reality application for auto maintenance and repair has the potential to greatly increase the availability of information about cars and give regular people the ability to carry out even the most basic repairs with ease. Regular maintenance can improve vehicle safety and lessen the workload for expert mechanics.

References -

Figure 1: Created using canva and its preloaded assets. accessible here: CANVA: Visual suite for everyone (2023) Canva. Available at: https://www.canva.com/ (Accessed: 08 October 2023). 

Petersons, E. (2023) Ultimate OBD2 Guide: Understanding Vehicle Diagnostics, AutoPi.io. Available at: https://www.autopi.io/blog/what-is-obd-2/#:~:text=It%20works%20by%20connecting%20the,the%20vehicle%20and%20collect%20DTCs. (Accessed: 03 October 2023). 

NiDirect (2022) Vehicle maintenance, safety and security, nidirect. Available at: https://www.nidirect.gov.uk/articles/vehicle-maintenance-safety-and-security (Accessed: 03 October 2023). 

Vuforia: Getting started (2023) Getting Started | Vuforia Library. Available at: https://library.vuforia.com/ (Accessed: 03 October 2023).