To modernize the app, we integrated Apple’s TrueDepth technology through Apple ARKit (via the Structure SDK). This enabled precise 3D foot scanning directly on iPads, eliminating the need for bulky, third-party occipital sensors. We also ensured backward compatibility for users who still preferred the older sensors.
In addition to hardware improvements, we updated the app’s codebase and redesigned the UI, making it more intuitive and responsive. This included adding real-time scanning feedback and other Quality of Life (QoL) features to enhance the user experience. The app now provides faster, more accurate scans while making it easier to maintain and scale for future updates.
By transitioning to native iPad technology, leveraging Apple ARKit (via the Structure SDK), we significantly improved performance while reducing operational costs and future-proofing the ap
Solution Breakdown
- User Interface, Flow, and Ease of Use:
- Redesigned UI for a more intuitive experience.
- Added on-screen instructions, real-time feedback (green/red color wheel), and sound notifications to guide users.
- Code Modernization:
- Updated the app’s codebase and dependencies for improved speed, security, and scalability.
- New Scanning Features:
- Integrated Apple TrueDepth ARKit via Structure SDK for precise 3D foot scans.
- Maintained support for occipital sensors.
- Enhanced scan conversion to .ply and .stl formats.
- Cloud Integration and Security:
- Implemented secure cloud storage via AWS with encryption for data in transit and at rest.
Innovations
- TrueDepth Integration: Leveraging Apple’s native TrueDepth sensor allowed us to vastly improve scanning accuracy and speed.
- Backward Compatibility: Users who still wanted to use the old occipital sensor could continue doing so, with seamless integration of both technologies.
- Real-Time Feedback: We introduced real-time feedback during scanning to reduce errors, recalibration, and the need for rescans.
High-Level Architecture
System Components
- Scanning Module: The core of the app’s functionality, utilizing both Apple’s TrueDepth camera and the Structure SDK for accurate, precise 3D foot scans
- Conversion Logic: Scans are converted into file formats like .ply and .stl, which are crucial for orthotic production.
- User Interface: A redesigned, user-friendly UI that walks podiatrists through the scanning and submission process with ease.
Security
All data, including 3D scans, is securely uploaded and stored on AWS, using encryption in transit and at rest to ensure patient privacy and data security.
Core Technologies
- Mobile Development:
- iOS (iPad-specific, iOS 13 and above): Tailored for iPad, ensuring smooth integration with modern hardware.
- Swift: Fast, efficient coding for building a high-performance app.
- Structure SDK: Integrated alongside Apple’s TrueDepth technology to support 3D scanning, ensuring both modern and legacy hardware compatibility.
- TrueDepth Scanning Technology: Provides sensor-free, precise scanning using the native iPad Pro camera.
- Backend & API Connectivity:
- REST API: Facilitates communication between the app, cloud storage, and the web portal, ensuring secure data exchange.
- AWS: Used for secure cloud storage of 3D scans and patient data, ensuring reliability and scalability for data management.
- Version Control & Project Management:
- Git: Version control for tracking changes and collaborating seamlessly across teams.
- Beanstalk: Repository hosting for efficient management of the codebase.
- Azure DevOps: Managed project workflows, bug tracking, and task assignments.
- Data Storage & Management:
- FileManager: Local storage solution for managing scan files on the device.
