Project Description

The client, a leading provider of foot scanning technology for podiatrists and custom orthotics manufacturers, approached us to enhance their app’s capabilities. The app plays a critical role in capturing 3D foot scans, which are used to create custom orthotic inserts for patients. As part of their commitment to enhancing service delivery and staying competitive in the orthotics market, the client sought a comprehensive upgrade. This included integrating the latest technology, such as Apple’s ARKit (via the Structure SDK) and TrueDepth technology, to enable seamless 3D foot scanning on iPads. 

Our role was to bring this vision to life by integrating cutting-edge technology while ensuring the app remained intuitive and accessible for their users. The goal was to future-proof the application while improving overall performance and user satisfaction. 

Challenge

Problem

The app faced several challenges, beginning with its reliance on outdated occipital sensors for 3D foot scanning. These sensors, which users found bulky and inconvenient, required the client to purchase third-party hardware, adding significant costs to their operations. 

In addition to the hardware issues, the app’s overall performance was lagging. Users frequently encountered scanning errors, and the outdated codebase and dependencies hadn’t been updated in years. This resulted in slow performance, poor user experience, and potential security risks due to the obsolete infrastructure. 

The app needed more than a simple update, it required a comprehensive overhaul of both hardware and software. The goal was to modernize the app by incorporating Apple ARKit and TrueDepth technology for improved performance, accuracy, and user experience, while eliminating the need for costly third-party sensors and saving the client money in the long run. 

Project Goals

  • Integrate Modern Scanning Technology: Transition from outdated occipital sensors to Apple’s TrueDepth technology, enabling precise 3D foot scanning directly on iPads.
  • Maintain Backward Compatibility: Ensure the app continues to support older occipital sensors for users who prefer the legacy hardware.
  • Improve Performance and Usability: Optimize the app’s codebase, UI, and scanning accuracy, creating a smoother and more intuitive user experience.
  • Reduce Costs: Eliminate the need for third-party sensors, reducing hardware expenses for the client and end-users.
  • Secure Data and Cloud Integration: Implement secure cloud storage and API integration to ensure patient data protection and seamless data transfers.

Challenge

Problem

The app faced several challenges, beginning with its reliance on outdated occipital sensors for 3D foot scanning. These sensors, which users found bulky and inconvenient, required the client to purchase third-party hardware, adding significant costs to their operations. 

In addition to the hardware issues, the app’s overall performance was lagging. Users frequently encountered scanning errors, and the outdated codebase and dependencies hadn’t been updated in years. This resulted in slow performance, poor user experience, and potential security risks due to the obsolete infrastructure. 

The app needed more than a simple update, it required a comprehensive overhaul of both hardware and software. The goal was to modernize the app by incorporating Apple ARKit and TrueDepth technology for improved performance, accuracy, and user experience, while eliminating the need for costly third-party sensors and saving the client money in the long run. 

Project Goals

  • Integrate Modern Scanning Technology: Transition from outdated occipital sensors to Apple’s TrueDepth technology, enabling precise 3D foot scanning directly on iPads.
  • Maintain Backward Compatibility: Ensure the app continues to support older occipital sensors for users who prefer the legacy hardware.
  • Improve Performance and Usability: Optimize the app’s codebase, UI, and scanning accuracy, creating a smoother and more intuitive user experience.
  • Reduce Costs: Eliminate the need for third-party sensors, reducing hardware expenses for the client and end-users.
  • Secure Data and Cloud Integration: Implement secure cloud storage and API integration to ensure patient data protection and seamless data transfers.

Solution

To modernize the app, we integrated Apple’s TrueDepth technology through Apple ARKit (via the Structure SDK). This enabled precise 3D foot scanning directly on iPads, eliminating the need for bulky, third-party occipital sensors. We also ensured backward compatibility for users who still preferred the older sensors. 

In addition to hardware improvements, we updated the app’s codebase and redesigned the UI, making it more intuitive and responsive. This included adding real-time scanning feedback and other Quality of Life (QoL) features to enhance the user experience. The app now provides faster, more accurate scans while making it easier to maintain and scale for future updates. 

By transitioning to native iPad technology, leveraging Apple ARKit (via the Structure SDK), we significantly improved performance while reducing operational costs and future-proofing the ap 

Solution Breakdown

  • User Interface, Flow, and Ease of Use:
    • Redesigned UI for a more intuitive experience.
    • Added on-screen instructions, real-time feedback (green/red color wheel), and sound notifications to guide users.
  • Code Modernization:
    • Updated the app’s codebase and dependencies for improved speed, security, and scalability.
  • New Scanning Features:
    • Integrated Apple TrueDepth ARKit via Structure SDK for precise 3D foot scans.
    • Maintained support for occipital sensors.
    • Enhanced scan conversion to .ply and .stl formats.
  • Cloud Integration and Security:
    • Implemented secure cloud storage via AWS with encryption for data in transit and at rest.

Innovations

  • TrueDepth Integration: Leveraging Apple’s native TrueDepth sensor allowed us to vastly improve scanning accuracy and speed.
  • Backward Compatibility: Users who still wanted to use the old occipital sensor could continue doing so, with seamless integration of both technologies.
  • Real-Time Feedback: We introduced real-time feedback during scanning to reduce errors, recalibration, and the need for rescans.

High-Level Architecture

TrueDepth Technology

System Components

  • Scanning Module: The core of the app’s functionality, utilizing both Apple’s TrueDepth camera and the Structure SDK for accurate, precise 3D foot scans
  • Conversion Logic: Scans are converted into file formats like .ply and .stl, which are crucial for orthotic production.
  • User Interface: A redesigned, user-friendly UI that walks podiatrists through the scanning and submission process with ease.

Security

All data, including 3D scans, is securely uploaded and stored on AWS, using encryption in transit and at rest to ensure patient privacy and data security. 

Core Technologies

  • Mobile Development:
    • iOS (iPad-specific, iOS 13 and above): Tailored for iPad, ensuring smooth integration with modern hardware.
    • Swift: Fast, efficient coding for building a high-performance app.
    • Structure SDK: Integrated alongside Apple’s TrueDepth technology to support 3D scanning, ensuring both modern and legacy hardware compatibility.
    • TrueDepth Scanning Technology: Provides sensor-free, precise scanning using the native iPad Pro camera.
  • Backend & API Connectivity:
    • REST API: Facilitates communication between the app, cloud storage, and the web portal, ensuring secure data exchange.
    • AWS: Used for secure cloud storage of 3D scans and patient data, ensuring reliability and scalability for data management.
  • Version Control & Project Management:
    • Git: Version control for tracking changes and collaborating seamlessly across teams.
    • Beanstalk: Repository hosting for efficient management of the codebase.
    • Azure DevOps: Managed project workflows, bug tracking, and task assignments.
  • Data Storage & Management:
    • FileManager: Local storage solution for managing scan files on the device.

Process

Team

Our team included mobile developers, testers, UX/UI designers, and a product manager. We worked closely with the client throughout the process to ensure we delivered exactly what they needed.

Development

We followed an agile process, with frequent check-ins and iterations. The project involved a full refactor of the app’s scanning, rendering, and conversion logic to integrate Apple’s ARKit and TrueDepth scanning capabilities. We also made sure the app’s new codebase was optimized for long-term performance and scalability.

Development Challenges

One challenge we faced was ensuring that both TrueDepth and occipital sensor technologies could coexist smoothly within the app. We designed a flow that allowed users to switch between them, keeping both options available for flexibility.

Testing

A rigorous testing phase was critical. We conducted unit tests, integration tests, and real-world testing with podiatrists to ensure the app performed as expected, with minimal lag and maximum accuracy.

Process

Team

Our team included mobile developers, testers, UX/UI designers, and a product manager. We worked closely with the client throughout the process to ensure we delivered exactly what they needed.

Development

We followed an agile process, with frequent check-ins and iterations. The project involved a full refactor of the app’s scanning, rendering, and conversion logic to integrate Apple’s ARKit and TrueDepth scanning capabilities. We also made sure the app’s new codebase was optimized for long-term performance and scalability.

Development Challenges

One challenge we faced was ensuring that both TrueDepth and occipital sensor technologies could coexist smoothly within the app. We designed a flow that allowed users to switch between them, keeping both options available for flexibility.

Testing

A rigorous testing phase was critical. We conducted unit tests, integration tests, and real-world testing with podiatrists to ensure the app performed as expected, with minimal lag and maximum accuracy.

Results

The updated app not only met but exceeded client expectations. Users can now scan feet more quickly and accurately using Apple’s TrueDepth camera, while those who prefer the occipital sensor can still rely on it. The app is faster, more reliable, and positioned for long-term scalability. By modernizing their app and moving away from third-party dependencies, the client is now better equipped to handle the future of the orthotics industry. 

Transform your medical imaging technology with modern, cost-effective solutions. Contact Xorbix today to explore how we can upgrade your healthcare applications. 

Generative AI
AI Services in Green Bay
Angular 4 to 18
TrueDepth Technology

Let’s Start a Conversation

Request a Personalized Demo of Xorbix’s Solutions and Services

Discover how our expertise can drive innovation and efficiency in your projects. Whether you’re looking to harness the power of AI, streamline software development, or transform your data into actionable insights, our tailored demos will showcase the potential of our solutions and services to meet your unique needs.

Take the First Step

Connect with our team today by filling out your project information.

Address

802 N. Pinyon Ct,
Hartland, WI 53029