1. Introduction
Ultrasound imaging, first introduced in the 1940s, has become a widely utilized diagnostic modality due to its radiation-free nature, portability, real-time imaging capabilities, and greater accessibility compared to computed tomography (CT) scans and magnetic resonance imaging (MRI) [
1]. However, traditional ultrasonography depends heavily on skilled operators, resulting in variability in image quality and reproducibility [
2]. Additionally, it poses risks to operators, such as musculoskeletal disorders and increased infection risk when scanning patients with infectious diseases [
3]. Robot-assisted ultrasound imaging may addresses these challenges by enabling consistent, precise, and faster scans, reducing human error and lowering healthcare costs [
4] while simultaneously mitigating the risk of operator injury and infection. A critical factor in advancing robotic ultrasound systems is the implementation of effective force control, which ensures optimal contact between the probe and the patient’s body. Excessive contact force can lead to patient injury, whereas insufficient force compromises image quality [
5]. Researchers adopt diverse approaches to force control in ultrasound robots, involving varying choices of sensors, control strategies, and implementation methodologies.
Robotic ultrasound systems employ various types of force sensors to ensure precise and safe interactions between the ultrasound probe and the patient’s body. Among these, external commercial force/torque sensors are widely used due to their accuracy and reliability, making them a preferred choice for precise force measurements. For instance, many systems utilize six-axis force/torque sensors, typically positioned between the robot arm and the probe, as demonstrated in studies by Merouche et al., Jiang et al., Kim et al., and Chen et al. [
6,
7,
8,
9]. Alternatively, some systems adopt different configurations, such as the approach described by Huang et al., which employs two one-axis sensors mounted on the front face of the ultrasound probe to measure the contact force between the probe and the patient [
10]. Beyond commercial sensors, custom-built sensors are also explored. Noh et al. developed a six-axis force/torque sensor using 3D-printing technology, demonstrating the feasibility of designing sensors tailored to specific tool shapes and functional requirements; however, this sensor has not yet been validated in clinical settings [
11]. Additionally, certain robotic ultrasound systems utilize built-in sensors integrated into the robot’s structure, offering a compact and streamlined solution for force feedback. Examples of such systems are detailed in the works of Goel et al., Suligoj et al., Virga et al., and Hennersperger et al. [
12,
13,
14,
15]. Each type of sensor—whether commercial, custom-built, or built-in—plays a pivotal role in enhancing the performance and accuracy of robotic ultrasound systems, with the choice of sensor often guided by the specific application requirements and system constraints.
The force control strategies for maintaining appropriate contact force during robotic ultrasound procedures vary across systems, each offering distinct advantages. A common strategy is applying a constant force, as implemented in [
6,
9,
13]. This approach provides simplicity and reliability, ensuring uniform probe–patient interaction that supports consistent imaging outcomes and basic patient comfort. Another approach involves maintaining contact force within a specific range, as seen in [
10,
15], where the force is dynamically adjusted to predefined limits. This strategy allows for a balance between safety and effectiveness by ensuring sufficient tissue contact to capture clear images while preventing excessive pressure that could lead to discomfort or injury. A more advanced method is applying a patient-specific contact force, utilized in [
7,
8,
14]. These systems tailor the force based on real-time feedback, such as ultrasound image quality or confidence maps, optimizing diagnostic accuracy by adapting to individual patient anatomy and imaging needs. Each of these strategies reflects a trade-off between simplicity, adaptability, and personalization in robotic ultrasound applications.
Various force control methods are employed to regulate the interaction force between the ultrasound probe and the patient, each offering specific advantages. Position control, as implemented in [
6], relies on precise robotic arm movements to maintain the desired force, providing a straightforward approach for force regulation. Impedance control, highlighted in [
9,
13], adjusts the robot’s compliance based on measured forces, enabling safer and more consistent contact by dynamically responding to force variations. Hybrid position–force control, used in [
8,
10,
12], combines the strengths of both position and force control to dynamically modulate the probe’s position and applied force. This approach ensures optimal contact with the patient and enhances image quality by balancing movement precision with force regulation. Compliance control, described in [
15], maintains a constant desired force within a specified range, allowing the system to adapt to varying tissue characteristics while ensuring both patient safety and imaging accuracy.
In addition to these force control strategies, some studies incorporate additional mechanical safety features to limit the maximum force, providing an extra layer of protection. Housden et al. [
16] developed a spring-ball-based mechanical clutch to mechanically restrict the force to a safe limit. Similarly, Tsumura et al. [
17] employed a constant-force spring mechanism that, combined with a counterweight system, ensures a steady and limited contact force by offsetting the probe’s weight and directly controlling the applied force. These mechanical safety features ensure that the interaction force remains within safe limits, enhancing patient safety during robotic ultrasound procedures.
In conclusion, current robotic ultrasound systems exhibit a diverse range of force sensors and control strategies. However, most of these systems rely on either standardized and costly commercial force sensors or the built-in sensors of commercial robot arms. There is a notable lack of solutions specifically designed for ultrasound scanning that utilize lightweight and cost-effective sensing systems for custom-made robots, which often lack sophisticated internal force sensors.
In this paper, we present a solution for automated extra-body ultrasound scanning, with a comprehensive robot control framework as the core contribution. Supporting this framework are innovations in sensor design, algorithm development, and validation through realistic testing, collectively advancing the feasibility of automated ultrasound in clinical applications. The key contributions of our work are as follows:
- (1)
Robot Control Framework: The primary contribution of this work is the development of a comprehensive robot control framework for automated ultrasound scanning. This framework integrates patient-specific surface-based path planning, operator inputs, and force-control algorithms, ensuring safe and consistent acquisition of high-quality ultrasound images. This framework represents a complete and robust solution for automated scanning in real-world scenarios.
- (2)
Force Sensor Design: To support the control framework, we designed a compact, single-axis force sensor using load cells that can be seamlessly integrated into the ultrasound probe. This sensor is optimized for 3D printing, reducing fabrication costs while providing reliable and accurate force measurements necessary for implementing the control algorithms.
- (3)
Phantom Design: We developed a two-layer abdomen phantom, featuring a stiff inner layer with an abdominal aortic aneurysm (AAA) and inferior vena cava (IVC) and a soft adipose-mimicking outer layer. This phantom closely resembles human tissue, allowing realistic testing of force-control algorithms and ultrasound imaging in a simulated clinical setting.
- (4)
System Validation: We validated the system’s performance through both phantom and healthy volunteer experiments, demonstrating its effectiveness in real-world scenarios.
This paper is organized into two main parts: sensor design and characterization, followed by robot control design and system performance testing. In the methodology section,
Section 2.2 and
Section 2.5.1 focus on the design and characterization of the custom force sensor, detailing its mechanical structure, signal processing, and calibration experiments.
Section 2.3,
Section 2.4,
Section 2.5.2 and
Section 2.5.3 describe the robot control algorithms, phantom design, and experimental setups for validating the system’s performance. In the results section,
Section 3.1 presents the outcomes of the sensor characterization experiments, including calibration, accuracy, and performance under real-world conditions.
Section 3.2 and
Section 3.3 evaluate the robot control algorithms and system performance, showcasing the integration of force control, path planning, and automated ultrasound image acquisition through both phantom and volunteer experiments. Finally,
Section 4 and
Section 5 discuss and conclude this research, respectively.
2. Materials and Methods
The aim of this research is to develop a system for automated ultrasound scanning of a target region, ensuring consistent force application within a predefined safe range. To achieve this, we began by implementing system registration and calibration to ensure precise alignment and tracking between the patient and the robotic system. We then designed and fabricated a cost-effective, custom-built force sensor tailored for ultrasound applications. Building on this, we developed a force control strategy to maintain optimal probe contact during scanning, ensuring patient safety and high-quality imaging. Finally, we constructed a detailed, ultrasound-compatible phantom as a realistic testing platform to validate the system’s functionality before advancing to patient trials.
2.1. Robotic System Setup and Workflow
This research advances a dual-arm robotic system, originally developed by our research team at King’s College London, for enhanced prenatal ultrasound screenings as detailed in [
18]. Featuring 17 degrees of freedom, the robot’s end effector is equipped with an ultrasound holder that mimics the dexterity of a human sonographer’s wrist. It is controlled through custom software developed in C++ using Qt Creator 8.0.2 (based on Qt 6.3.2, GCC 10.3.1, The Qt Company Ltd., Espoo, Finland). The software not only allows real-time visualization of the robot’s pose and the patient’s surface mesh but also supports various control methodologies, including motor and endpoint control. This makes it highly suitable for both research and clinical applications. Additionally, the system is ethically approved for abdominal scans, including use with pregnant women. The system incorporates patient-to-robot registration and real-time movement detection using two 3 cm × 3 cm AprilTag markers—one placed on the patient and the other on the robot—along with an Intel RealSense RGB-D camera, as shown in
Figure 1. This setup enables the robot to continuously track the patient’s position and dynamically adjust for any patient movement. Additional details can be found in our previous work [
19].
The general workflow of our current system for autonomous robotic ultrasound acquisitions is illustrated in
Figure 2. The system operates in two main stages: Before Acquisition and During Acquisition. In the Before Acquisition stage, an external RGB-D camera captures the patient’s surface information, which enables real-time patient-to-robot registration using AprilTag markers. This process ensures that the scanned patient surface aligns correctly within the robot control’s simulation environment, allowing the sonographer to precisely select the desired scanning region in the software. The robot then moves to the corresponding location on the patient’s body to perform the scan. During the image acquisition stage, the robot autonomously follows a scanning path defined by the sonographer while actively monitoring and adjusting contact force via force sensors. It dynamically modifies the path in response to patient movement and force feedback, ensuring safe and accurate image acquisition. Upon completion, the acquired ultrasound images can be transferred to healthcare professionals or AI-based algorithms for further assessment, facilitating diagnostic support or advanced analysis.
2.2. Force Sensor Design for Ultrasound Probe Compatibility
2.2.1. Mechanical Structure Design
In most robotic ultrasound systems, the force sensor is typically positioned either at the probe face to measure the direct force between the patient and the probe [
10] or at the top of the probe [
6,
7,
9], between the robot end and the probe, for ease of mounting on the robot. However, placing the sensor on the probe face limits the sensor size and can cause shadowing on the ultrasound image. On the other hand, mounting the sensor at the top of the probe leads to indirect and less accurate force measurements due to the complexity of force transmission.
To overcome these challenges, our goal is to design a round-shaped force sensor that holds the probe similarly to a human sonographer, inspired by and building upon our previous model [
11]. We aim to create a sensor that is not only affordable and easy to manufacture but also widely accessible to researchers and industries around the world. By focusing on a straightforward structure and force-sensing principle, we can ensure that the sensor is easy to repair if needed. Additionally, since this sensor is intended for clinical use, it is designed to be robust and capable of long-term operation without failure. Lastly, the sensor is designed to be adaptable to a wide range of commonly used ultrasound probe types and robotic systems, ensuring broad applicability for various research and clinical applications.
To meet these requirements, we have selected the FX29 Compact Compression Load Cell from TE Connectivity as the basic element. These load cells are cost-effective, readily available, and can be easily replaced if damaged, avoiding the need to rebuild the entire sensor. The proposed sensor consists of four parts, as is shown in
Figure 3. The left and right parts are separate to fit the probe, while the upper and lower parts are separate to facilitate easy replacement of the load cells. The lower part is designed to hold the probe firmly, with its inner shape derived from the probe’s CT scan. The upper part is designed to fit the sensor into the robot’s end effector based on the robot’s CAD model. The left-right and upper-lower parts of the sensor can be easily modified and reprinted to accommodate different probe shapes and robotic configurations, making the sensor highly adaptable.
The load cells are evenly distributed on the lower plate, providing a stable structure. Eight cylinders extend from the top half; four are designed to push the load cells at their centres, with lengths matching the upper and lower gap to prevent undue pressure on the load cells when unloaded. The remaining four cylinders are supporting cylinders with tiny bulges at their ends (
Figure 3d). By applying pressure, these supporting cylinders fit securely into corresponding holes in the bottom plate, ensuring that upper and lower parts fit together during scans. The holes for the supporting cylinders are designed to be 2 mm deeper than the cylinders themselves. This 2 mm gap exceeds the maximum deformation expected in the load cells, allowing the supporting cylinders to move freely downward under pressure without transferring force. The entire sensor structure is fabricated using 3D-printed PLA material, optimizing for both function and manufacturing efficiency.
The sensor is calibrated as a single-axis force sensor, meaning it only measures forces perpendicular to the plane of the four load cells. The total force () is computed by summing the readings from the four load cells. This calibration ensures accurate measurement of vertical forces, which is used in subsequent force-control algorithms.
2.2.2. Force Sensor Signal Processing
In this research, we implemented a load cell system using four load cells with I2C communication, each with four wires: power, ground, clock, and data. The load cells were assigned unique I2C addresses and connected to a shared I2C bus using ribbon cables for improved organization and reliability. The system features a custom-made printed circuit board (PCB) equipped with pull-up resistors and a zero (tare) button, which is crucial for calibrating the load cells before operation (
Figure 4b). The I2C signals are processed by a Teensy 4.1 microcontroller (PJRC, Sherwood, Oregon, USA) housed in a custom 3D-printed enclosure mounted beneath the robot arm (
Figure 4c). The Teensy 4.1 reads the load cell data from the PCB and transmits them to the robot’s main microcontroller for force control. This setup not only ensures seamless integration of load cell data with the robot’s control system but also allows for easy replacement of damaged load cells and direct signal access for debugging purposes (
Figure 4d).
2.3. Robot Control Algorithm Design
2.3.1. Force Control Strategy Design
To ensure safe and effective scanning, we implemented a force control strategy that dynamically adjusts the probe’s position to maintain the contact force within a patient-specific, predefined range. This range is designed to balance safety and image quality during extra-body ultrasound procedures. The “force” referred to here is (
), the total vertical force calculated as the sum of the four load cells, as described in
Section 2.2.1.
Our system employs a proportional (P) control strategy, a simple yet effective approach for maintaining consistent force. The system continuously monitors the contact force and calculates the deviation from the desired range. If the current force is within the range, no adjustment is needed. However, if the force exceeds or falls below the desired range, an adjustment is applied to the probe’s position to correct the error.
The adjustment distance,
, is calculated as:
where
represents the deviation from the target force range, and
is the proportional control coefficient tuned based on the softness of the tissue. Softer tissues require higher
values for greater sensitivity to force changes, while firmer tissues require lower
values to prevent overcorrections.
To enhance the system’s precision, the robot calculates the normal direction of the surface at each contact point. Adjustments to the probe’s position are made along this normal direction, ensuring that the ultrasound probe maintains optimal alignment with the scanning surface. The new target position is determined as:
2.3.2. Path Planning
To achieve a higher level of automation, we equipped our robot with autonomous scanning path planning, implementing two distinct methods: direct path planning and area coverage path planning.
We first designed a user interaction interface to enable users to select path points and save them in sequence. The interface, shown in
Figure 5, includes a 3D model of the patient’s abdomen and a simulated robotic arm, facilitating intuitive interaction. Using the Visualization Toolkit 7.1 (VTK) in the C++ library, we created an interactive window that visualizes the path point selection process.
In direct path planning, users manually select specific points on the 3D model by right-clicking on the desired locations. For each selected point, the system retrieves its 3D pose as a 4 × 4 transformation matrix, which encodes both the position and orientation information. These poses are stored sequentially to define a predefined scanning path. A red sphere visually marks the selected points on the 3D model, providing immediate feedback to the user, as shown in
Figure 5a. This method is particularly suitable for small scanning areas with clear anatomical landmarks, such as the belly button or nipples, allowing for precise path customization.
In area coverage path planning, users define a rectangular scanning region by clicking and dragging the mouse over the desired area on the model. This action prompts VTK to capture the start and end points of the drag, which are then used to compute the four corner coordinates of the rectangle (
Figure 5b). Based on these coordinates and the size of the ultrasound probe, a serpentine (zig-zag) path is generated to ensure complete coverage of the selected region. These path points are automatically calculated and stored in sequence for the robot to follow during scanning. This method is particularly advantageous for larger regions without clear anatomical landmarks, offering a more automated solution.
By integrating path planning with force control, the robot dynamically maintains safe and accurate alignment with the surface during scanning, ensuring optimal image quality and patient safety.
2.4. Tissue-Mimicking Phantom
To validate the force control mechanism of the robot, an abdominal phantom was developed. This model is critical for assessing abdominal aortic aneurysm (AAA), combining an idealized AAA model and an inferior vena cava (IVC) based on published vessel measurements from computed tomography and ultrasound scans. The abdomen phantom includes a stiffer layer containing the AAA and IVC, along with an outer adipose tissue layer to interact with the robotically controlled ultrasound (US) probe (
Figure 6a).
Three-dimensional models of the lumens of the AAA and IVC were created based on aggregate dimensions from CT scan measurements. Models were 3D-printed using a desktop fused filamented fabrication printer. The AAA and its branches were printed in polyvinyl alcohol (PVA), a water-soluble synthetic resin, while the box and the unbranched IVC were printed in polylactic acid (PLA). Both pieces were coated with epoxy resin to create a smooth surface finish.
To create the stiffer inner layer of the phantom, a polyurethane rubber, Vytaflex 20 (Smooth-On Inc., Macungie, PA, USA), was chosen due to its Shore hardness of 20A and elastic modulus of . The urethane rubber was degassed in a vacuum chamber to eliminate air bubbles—a process essential to minimizing artefacts in imaging. The mixture was then poured into the box until the AAA and IVC lumen models were just covered and left to cure.
Following curing, the PVA model was dissolved in a heated and stirred water bath. The PLA model was removed by applying force to one end of the model.
To make the phantom more realistic to human abdomen tissue, the outer adipose layer simulating subcutaneous fat was added. A mixture of BJB F116 and BJB SC22 polyurethane rubber (BJB Enterprises, Tustin, CA, USA) was used, resulting in a flexible, realistic layer with a shore hardness of 00-15.
An ultrasound image of the phantom is shown in
Figure 6b. For optimal imaging, ultrasound gel was applied between the two layers, and the phantom was submerged in water to a level above the vessels and below the probe. Scanning was performed using an EPIQ 7G Philips ultrasound machine (Bothell, WA, USA) and the Philips X6-1 ultrasound probe, optimized for abdominal imaging with a frequency range of 6–1 MHz. Minimal force was applied to the probe, which was sufficient to clearly delineate the boundaries of the two embedded vessels, mimicking realistic visualization conditions.
The ultrasound image reveals distinct vessel boundaries with minimal signal artefacts, indicating an effective simulation of abdominal structures. The contrast and clarity in the image suggest that the phantom’s materials and layer composition are appropriate for testing the force control and imaging capabilities of the robot, especially for applications like AAA assessment. This setup provides a reliable platform for evaluating the interaction between the robotically controlled ultrasound probe and simulated soft tissue, enhancing the realism and utility of the testing environment.
2.5. Experimental Design and Setup
This section outlines the design and setup of experiments conducted to validate the system’s performance, focusing on sensor accuracy and robotic control. The force sensor testing experiments ensured the reliability of the custom-designed sensor when integrated with the robotic system. The force-control algorithm testing experiments were designed to validate the robot’s ability to maintain target forces during sweeping motions, a key factor for ensuring patient safety. Finally, the automated ultrasound image acquisition experiments on phantom and volunteer subjects were designed to validate the system’s ability to acquire clear, clinically usable images under real-world conditions, such as patient breathing and varying tissue properties.
2.5.1. Experimental Setting for Force Sensor Calibration and Performance Evaluation
As mentioned in
Section 2.2.1, four load cells are evenly spaced on the same level and positioned on the lower part of the force sensor. As the four load cells share the total Z-axis force, the final sensor reading is obtained by summing the individual readings from each load cell. The force sensor calibration was conducted by applying known weights ranging from 0 g to 3500 g in increments of 500 g (
Figure 7a). For each weight, the corresponding sensor readings were recorded. The calibration function was determined by calculating the linear fit of the sensor’s raw data against the known weights. After deriving the calibration function, the sensor’s accuracy, stability, and hysteresis were evaluated through further testing. To assess stability, known weights were applied to the sensor and held for 5 s, during which all sensor readings were recorded. The standard deviation of these readings was calculated to quantify the sensor’s stability. Accuracy was evaluated by averaging the sensor’s readings over the same period and comparing the result with the applied weight. Finally, hysteresis testing involved sequentially applying and removing weights one by one over five cycles. The sensor readings during the loading and unloading phases were compared to identify any discrepancies or lag in the sensor’s response.
We designed another experiment to test the sensor performance under the real ultrasound scanning scenario. In this experiment, the sensor was mounted onto the robot’s end effector to assess its performance under real ultrasound scanning conditions. In this experiment, the force applied by the robot arm was unknown, so an ATI Mini40 force sensor (ATI Industrial Automation, Apex, NC, USA) was used as a reference. As shown in
Figure 7b, the ATI sensor was securely mounted on a custom-designed support platform to ensure stability and prevent slippage. The robot arm was positioned at various angles along different axes, including both in-plane and out-of-plane rotations, to push the ATI sensor and mimic real ultrasound scanning scenarios. A total of 32 poses were tested to evaluate the performance of our custom-designed force sensor. These poses included straight pushes along the Z-axis, lateral angles ranging from −25° to +25° in increments of 5°, elevational angles from −25° to +25° in 5° increments, and axial rotations from −60° to +60° in increments of 20°. Because the ATI sensor measures force along the global Z-axis, while our custom sensor measures force relative to the ultrasound probe’s axis, we calculated the projected force component on the global Z-axis for comparison with the ATI readings. It is important to note that the ATI sensor’s readings include the weight of the probe and the sensor itself, in addition to the force applied by the robot arm. These weights were premeasured and subtracted from the ATI’s readings.
2.5.2. Experimental Setup for Force-Control Algorithm
In order to verify the usability and reliability of the surface force-following mode in the Z direction, we designed a platform for conducting the standalone force control experiment, as shown in
Figure 8. The whole experiment was divided into the following steps: (1). One AprilTag marker and an ATI sensor were securely mounted on a 3D-printed platform, with the sensor fixed using screws. Another AprilTag marker was attached to the robot arm. (2). A depth camera was used to collect the pose data of the AprilTag markers on the platform and on the wrist of the robot in real time. (3). The platform was moved up and down by hand and we observed whether the robot follows the movement of the platform. In this process, we set the desired force range to be 3–6 N. (4). We observed the sensor data, i.e., the change in contact force, during the control of the platform moving up and down, and tried to keep the force values at less than 3 N, 3 N–6 N, and more than 6N, each for a certain period of time.
To assess the surface force-following function with the path-planning algorithm, we performed an automated scan on our AAA phantom (without the adipose layer). Initially, the 3D surface of the phantom was scanned and imported into the software. Users can employ the two-point rectangle method to manually select the upper-left and lower-right corners of the rectangle, after which the software automatically calculates the remaining two corners to define the full scanning area, as shown in
Figure 9. The robot was programmed to execute a full-coverage scan within this designated area, aiming to maintain a consistent contact force ranging between 3 N and 6 N throughout the process. This force range was manually set to ensure optimal contact between the probe and the phantom surface. However, since the ideal force range varies among individuals, this range will be adjusted accordingly for volunteer scans.
2.5.3. Experimental Setup for Automated Ultrasound Image Acquisition
Following the successful validation of the integrated functionality of the path-planning-based force-control algorithm, the system was deemed ready for automated ultrasound image acquisition using a real ultrasound probe. The setup for this acquisition process is illustrated in
Figure 10. To mimic clinical imaging conditions and minimize surface friction, the AAA phantom was submerged in water, which eliminated air bubbles that could interfere with ultrasound signal transmission. The water level was carefully maintained below the ultrasound probe to ensure smooth probe movement without submerging the probe. Ultrasound gel was also applied between the probe and the phantom to ensure optimal contact. The custom-designed force sensor securely housed the ultrasound probe and was mounted on the robot’s end effector. Two AprilTag markers and one external camera were used to register the phantom with the robot. A standby operator was standing near the robot and phantom to monitor the entire process, ready to press the emergency stop button if necessary. For added safety, this emergency stop button will be given to volunteers or patients in human trials.
The phantom test procedure follows the same methodology as in
Section 2.5.2, where the robot autonomously plans its path to cover the user-defined region while maintaining applied force within a specified range. In this experiment, however, our primary focus shifted to evaluating the system’s ability to acquire ultrasound images and analyzing the image quality obtained under varying force levels.
Lastly, we conducted volunteer tests to evaluate the system’s performance under real-world conditions, including patient breathing and variations in tissue stiffness. We obtained ethical approval from the King’s College London local ethics committee to test our robotic ultrasound system on volunteers for general abdominal scans (study title: Investigating Robotic Abdominal Ultrasound Imaging, study reference: HR-22/23-5412). Although our long-term goal is to develop a universal automatic ultrasound scanning protocol, this study first focused on the imaging of the abdominal aorta and common iliac arteries as an initial application due to the relatively straightforward motion planning requirements.
Two volunteers with different body shapes participated in the study: Volunteer 1 with a body mass index (BMI) of 21 and Volunteer 2 with a BMI of 33. The experimental setup, illustrated in
Figure 11, was similar to the phantom test. In this configuration, the volunteer lay on a bed, with the RGB-D camera and robot positioned on their left side. The robot held an ultrasound probe connected to the ultrasound machine, which was located on the volunteer’s right side. The ultrasound system used was the Philips EPIQ 7G paired with the X6-1 probe (Philips Healthcare, Amsterdam, Netherlands), consistent with the phantom test setup. For safety, each volunteer was provided with an emergency stop button to hold during the procedure. If pressed due to discomfort, the robot’s power was immediately cut off, halting all operations to ensure the volunteer’s safety and comfort.
The volunteer test consisted of three distinct stages: (1) a manual scan performed by the operator, (2) a robotic scan conducted at the same position with varying levels of applied force, and (3) an automated robotic sweep designed to cover the entire region of interest.
Unlike scanning a phantom, which contains only two vessels and is composed of materials specifically designed for ultrasound imaging, the anatomy of the human abdomen is far more complex and varies between individuals. Therefore, the initial step is to locate the abdominal aorta or the common iliac arteries for each volunteer. To achieve this, we performed a freehand ultrasound scan. The scan is conducted exclusively in the transverse plane (where the aorta appears as a circular structure in the ultrasound image), as the diameter of the aorta is a critical criterion for detecting aneurysms. We initially positioned the probe on the volunteer’s abdomen, several centimetres to the left of the umbilicus. In the resulting ultrasound image, the top corresponds to the volunteer’s skin surface, while the bottom represents the spine and posterior structures. There are a number of key features used to identify the aorta. It appears as a circular structure with bright walls and a dark lumen. This is distinguished from the inferior vena cava (IVC), which has thinner walls and therefore appears less bright. The IVC is also less circular than the aorta due to the thinner walls and reduced intraluminal pressure (
Figure 12a). This distinction can be further confirmed by the pulsing motion observed in B mode in the aorta, which is particularly clear in slimmer individuals. The pulsatile nature of the aorta can also be demonstrated with colour and spectral Doppler (
Figure 12b), which contrasts to the respiratory modulated phasic flow demonstrated in the IVC. Anatomically, the aorta is situated just superficially to the spine, and to the left of the IVC. The spine appears as a curved structure at the bottom of the image, with a bright boundary and dark interior. Throughout this process, the sonographer must also adjust the ultrasound machine settings, including gain, depth, and focus, to optimize the image quality. These parameters are patient-specific and are carefully fine-tuned to ensure clear visualization of the aorta and surrounding structures.
After identifying the location of the aorta or iliac artery, the next step was to determine the optimal force range required to acquire high-quality ultrasound images for each volunteer. This force range was later used during the automatic scanning process. In this step, the ultrasound probe was mounted on the robot, and the system was operated in “kinematics control” mode to vary the probe’s depth in the Z-direction. Force values and their corresponding ultrasound images were recorded across a range of forces, from 2 N (representing minimal full contact) to 10 N. The results are presented in
Figure 13. For Volunteer 1 with BMI = 21, optimal image quality was observed within the force range of 3–6 N. For Volunteer 2 with BMI = 33, optimal images appeared at 4–10 N. However, to balance image quality with patient comfort, the desired force range for automatic scanning was set to 4–7 N. As the applied force increases, depth to the centre of the aorta/iliac artery decreases. This occurs because the increased force causes the abdominal tissue to deform downward, compressing and displacing any gas pockets, which brings the probe closer to the aorta/iliac artery.
The third step mirrored the process used in the phantom test: selecting a region of interest within the robot control software and allowing the robot to automatically scan that area while maintaining the applied force within the predetermined range. For both volunteers, the region around the umbilicus was selected, with efforts to position the manual scan point at the centre of the targeted area.
4. Discussion
In this study, we developed a compact, single-axis ultrasound probe force sensor and implemented an automated ultrasound acquisition method for AAA using a custom-designed ultrasound robot. By combining path-planning with surface force-following control, the system enables full-coverage scanning within a defined area while maintaining a consistent force range, demonstrating promising potential for safe and effective robotic ultrasound scanning.
The custom-designed force sensor offers multiple advantages for robotic ultrasound applications. It is inexpensive and easy to manufacture with 3D printing, making it accessible for research and clinical use worldwide. Additionally, the sensor’s round shape and probe-holding mechanism mimic the grip of a human hand, ensuring stable contact. Sensor performance tests revealed high linearity and accuracy, with minimal hysteresis, indicating that the sensor is well suited for abdominal scanning. Experiments demonstrated that the force-control algorithm effectively responds to platform movements, maintaining a consistent distance between the markers on the robot’s wrist and the platform while dynamically adjusting the probe’s position to ensure optimal force application.
Integrated experiments combining force-following control with path planning validated the system’s ability to maintain a stable scanning trajectory while keeping contact force within safe thresholds, which is critical for patient comfort and safety. Additionally, it successfully acquired diagnostically usable abdominal aorta ultrasound images from two volunteers with different body shapes, demonstrating adaptability to variations in tissue properties and body composition. This adaptability marks a crucial step toward expanding the use of robotic ultrasound systems across diverse patient populations in healthcare settings.
Despite its advantages, the current sensor design has limitations. It measures force along only a single axis, limiting its ability to detect angular misalignments. To address this, future iterations should explore multi-axis force sensing, utilizing the four-load-cell design to enable three-axis measurements. This enhancement, coupled with an improved control algorithm, would allow for corrective tilting and more precise alignment with complex anatomical surfaces. Additionally, the current force-following control relies on a fixed proportional gain, which limits adaptability to sudden changes in surface position, such as those caused by patient movement or respiration.
In addition to addressing the current limitations, we are exploring the integration of image feedback into the system. This involves developing methods to automatically assess ultrasound image quality in real time and leveraging this feedback to optimize the probe’s position and orientation. Furthermore, diagnostic scans for AAA, as specified by the National Abdominal Aortic Aneurysm Screening Programme (NAAASP) [
20] guidelines, must encompass the region from the diaphragm to the iliac bifurcation, necessitating precise probe alignment and positioning. To ensure accurate measurements, it is crucial to avoid oblique angles when the aorta is not parallel to the probe. These advancements represent key areas for future development aimed at enhancing the system’s diagnostic utility and clinical applicability.