top of page
orthopractis.com
VR Goggles

HandMovementApp

HandmovementApp 1.png

     Introducing an incredible app that tracks your hand's positional movements with unmatched precision! By continuously detecting 27 hand landmarks, it calculates and displays joint angles in real-time for your fingers and thumb, including DIP, PIP, MCP, and more! Imagine flexion, extension, abduction, and adduction effortlessly, especially during gripping motions or carpal assessments.

This versatile tool is a game-changer across various fields like orthopaedic, rehabilitation, sports training, and even music practice, empowering healthcare providers and students alike to enhance performance and track progress like never before!

Description

 

App track hand positional movements, by detecting continuously 27 hand landmarks, calculates in real time and displays the following joint angles, DIP (Distal Interphalangeal), PIP (Proximal Interphalangeal), MCP (Metacarpophalangeal)  for Index (I),Middle (M), Ring (R) Little (L) finger  and Thumb (T) in addition for thumb  CMC (Carpometacarpal) Joint and IP(Interphalangeal) , respectively during movements. Angles measured subtend between the related anatomical hand bones to respective joint.The centre of the carpus is estimated and depicted over its physical location representing  the origin of XYZ axis ,3D planes overlaid around each hand. App allows the measurements Flexion,Extension, Abduction, Adduction in separate planes.Feature useful especially in case of carpal or thumb measurements where movements are happening in different planes during opposition or gripping motions. Angles are measured real time in situ in immersive space for each joint respectively. By selecting measurement at certain plane  (XY, YZ, XZ) the angle  projection in immersive space is being estimated.

An application that can be beneficial in a wide range of uses in everyday practice across various fields such as Orthopaedics and hand surgery, Rehabilitation and Physical Therapy,Occupational Therapy,Sports and Athletic Training,Prosthetics and Assistive Technology,Research and Development,Handwriting Improvement,Guitar or Piano Practice,Gaming and Virtual Reality,Education and Learning,Workplace Ergonomics,Gaming and Entertainment. This hand recognition and movement analysis app is highly versatile and can significantly impact various areas of everyday practice.

The app can be used to measure the range of motion and specific movements of each joint, healthcare providers especially orthopaedic surgeon  can better assess the severity of conditions and track progression over time.By analyzing finger and wrist movements, doctors can track how joint stiffness, pain, or deformity affects hand function.After procedures like tendon repair or joint replacement, real-time data can help measure the patient’s progress and adapt rehabilitation exercises accordingly. Can guide them through exercises, measure their range of motion, and provide feedback on improvement or areas that need more focus.Physical therapists can use the app to create customized exercise programs for patients based on the specific range of motion data collected. The app can track the patient’s performance and adjust exercises accordingly.Researchers in biomechanics can use the data collected by the app to study hand movements, joint dynamics, and develop new models for understanding human hand function.For students learning fine motor skills, such as playing a musical instrument, drawing, or surgery techniques, the app provides detailed feedback and progression tracking.  

Disclaimer.

Regarding its plausibility app offers no diagnosis or treatment. App provide an early indication that further evaluation may be warranted by Speciality Doctor.  Explicitly is announced that the apps are not for diagnosis. Clinical judgment and experience are required to properly use the software. App alone do not replace an M.D. or specialist. All information received from the App output must be reviewed before any attempted treatment. The software is not for primary image interpretation. Any influence to the operators in making decisions remains user own responsibility and experience. App does not dispense medical advice. Patient should seek a doctor’s advice in addition using the app and /or before making any medical decisions for themself. Never substitute or replace doctors advice or change treatment modalities based on any measured outcome. App indicated for assisting healthcare professionals for scientific and research reason. Clinical judgment and experience are required to properly use the app and further research and validation is pending in coming future.

Help How to use it 

 

By activating the Immersive space Button  user enters the  Immersive space  and tracking of  both hand begins. XYZ  3D  perpendicular planes appear with different colours overlaid in each hand as long as they are in operators view. By detecting continuously  27 hand landmarks, tiny green spheres appear over the the hand and the fingers.Each green sphere represent a certain anatomic bone of hand and angles measured subtend between  the related anatomical  bone related to respective joint of the finger.

The centre of the carpus is estimated and and depicted  by a coloured red sphere  over its physical location  and represents the origin of XYZ  of 3D planes planes which  intersect and surround each hand.

Apple Vision Pro system continuously track hand positional movements calculate in real time and displays the following joint angles DIP (Distal Interphalangeal), PIP (Proximal Interphalangeal), MCP (Metacarpophalangeal)  for   Index (I),Middle (M), Ring (R) Little (L) finger  and Thumb (T)/in addition for thumb  CMC (Carpometacarpal) Joint

and IP(Interphalangeal)  respectively during movements.

App allows the measurements Flexion,Extension,Abduction Adduction in separate planes by activating the one of three related buttons. Feature useful especially in case of carpal or  thumb measurement where Flexion,Extension,Abduction Adduction are happening in different planes during thumb opposition or gripping motions  and entails more complicated measurements. 

 

XY, YZ, XZ Planes.

 By default angles measured in situ in immersive space for each joint respectively without measuring projections. App offers measurement of the projections of angles at planes (XY, YZ, XZ) in immersive space by estimating the projections of hand landmarks points in these planes which are visualised over the hand’s  during movement in three-dimensional space. The following planes are depicted

XY plane: Movement on  saggital plane  Blue for lest hand , cyan for right hand 

YZ plane: Movement on the transverse plane. Green for left hand, grey for right  hand 

XZ plane: Movement in frontal plane red for left hand orange for right hand.

 

 

Normal range of movements in quick review 

1.Wrist 

CARP: Refers to the wrist's movement, which may include flexion, extension, and deviation, depending on the position of the hand.

Flexion (Palmar Flexion): 0 to 80°

Extension (Dorsiflexion): 0 to 70°

Radial Deviation (Abduction): 0 to 20°

Ulnar Deviation (Adduction): 0 to 30°

2. Fingers (Metacarpophalangeal (MCP) Joints)

Flexion: 0 to 90°

Extension: 0 to 45°

Abduction: 0 to 20°

Adduction: Return to midline (0°)

3. Fingers (Proximal Interphalangeal (PIP) Joints)

Flexion: 0 to 100°

Extension: 0°

4. Fingers (Distal Interphalangeal (DIP) Joints)

Flexion: 0 to 90°

Extension: 0 to 10°

5.Thumb (Carpometacarpal (CMC) Joint)

Flexion: 0 to 15°

Extension: 0 to 20°

Abduction: 0 to 70°

Adduction: Return to midline (0°)

Opposition: Variable, depending on individual anatomy

Thumb (Metacarpophalangeal (MCP) Joint)

Flexion: 0 to 50°

Extension: 0°

Thumb (Interphalangeal (IP) Joint)

Flexion: 0 to 80°

Extension: 0°

An application  that can be beneficial in a wide range of uses in everyday practice across various fields such as 
1. Medical  and Rehabilitation Applications:
Diagnosis and Assessment: The app can be used to measure the range of motion and specific movements of each joint, healthcare providers especially orthopaedic surgeon or orthopadic hand surgeons can better assess the severity of conditions and track progression over time.
Hand Function Assessment: Clinicians can use this tool to assess conditions like arthritis, carpal tunnel syndrome, or tendon injuries. By analyzing finger and wrist movements, doctors can track how joint stiffness, pain, or deformity affects hand function.
Post-Surgery Rehabilitation: After procedures like tendon repair or joint replacement, real-time data can help measure the patient’s progress and adapt rehabilitation exercises accordingly.
Patients recovering from hand surgeries or injuries can use the app to track their progress. The app can guide them through exercises, measure their range of motion, and provide feedback on improvement or areas that need more focus.
Telemedicine: In remote healthcare, patients can use the app to demonstrate their hand movements to doctors without needing to visit the clinic physically. This is particularly useful for follow-up consultations and for patients in remote areas.
2. Physical Therapy:
Personalized Exercise Programs: Physical therapists can use the app to create customized exercise programs for patients based on the specific range of motion data collected. The app can track the patient’s performance and adjust exercises accordingly.
Real-Time Feedback: During therapy sessions, the app can provide real-time feedback on the patient’s movements, helping them correct their posture or movement patterns to avoid injury and optimize recovery.
3. Occupational Therapy:
Activity Simulation: The app can simulate daily activities that require specific hand movements, helping occupational therapists assess how well a patient can perform tasks like gripping, typing, or holding objects.
Ergonomic Assessment: Occupational therapists can use the app to evaluate the ergonomics of a patient’s hand movements, particularly in work environments that require repetitive motions, helping to design interventions to prevent strain injuries.
4. Sports and Athletic Training:
Performance Analysis: Athletes, particularly those in sports requiring fine motor skills (e.g., tennis, golf, rock climbing), can use the app to analyze their hand movements and improve their techniques.
Injury Prevention: The app can help in identifying risky hand movements or overuse patterns that could lead to injuries, allowing athletes and coaches to modify training programs to avoid them.
5. Prosthetics and Assistive Technology:
Prosthetic Hand Training: For users of prosthetic hands, the app can help in training by measuring and guiding the range of motion and grip strength. It ensures that the prosthetic is being used effectively and comfortably.
Assistive Devices: The app can be used to calibrate and control assistive devices that enhance hand function, making sure they align perfectly with the user’s natural movement patterns.
6. Research and Development:
Biomechanics Research: Researchers in biomechanics can use the data collected by the app to study hand movements, joint dynamics, and develop new models for understanding human hand function.
Product Development: Designers of ergonomic tools, keyboards, or other hand-related products can use insights from the app to create better, more user-friendly designs.
7. Everyday Use:
Handwriting Improvement: Users can practice and improve their handwriting by analyzing the fine motor control of their fingers, which can be particularly beneficial for children or adults learning to write or improving their handwriting.
Guitar or Piano Practice: Musicians can analyze their finger placements and movements, helping them refine their technique, increase speed, or prevent strain from improper hand positioning.
8. Gaming and Virtual Reality:
Enhanced Interaction: In gaming or virtual reality (VR), the app can be used to track hand movements for more immersive and accurate interaction within digital environments.
Accessibility in Gaming: The app can help create more accessible gaming experiences for users with limited hand mobility by customizing controls based on their specific range of motion.
9. Education and Learning:
Anatomy Education: The app can serve as an educational tool to teach students about the anatomy of the hand, showing the function and movement of each joint in a highly interactive way.
Skill Development: For students learning fine motor skills, such as playing a musical instrument, drawing, or surgery techniques, the app provides detailed feedback and progression tracking.
10. Workplace Ergonomics:
Ergonomic Assessments: This technology could assess how individuals interact with tools or computers, helping to design more ergonomic workstations that reduce the risk of repetitive strain injuries.
11.Gaming and Entertainment:
Motion Tracking for VR Games: Hand tracking is a crucial component in virtual and augmented reality gaming. It allows players to interact with the virtual world more naturally by using their hands, making the gaming experience more immersive.

Conclusion:
This hand recognition and movement analysis app is highly versatile and can significantly impact various areas of everyday practice. Whether it’s used for medical purposes, physical therapy, sports, education, or even daily tasks, the ability to accurately measure and analyze hand movements provides valuable insights that can enhance performance, might prevent injuries, and improve overall hand function.
It could be proven an valuable tool in every practice 

bottom of page