摘要:Traditional vision-based measurement techniques perform poorly on transparent glass surfaces, while tactile sensing is constrained by low sampling efficiency and limited resolution, impeding high-precision surface reconstruction. To address these limitations, a vision-tactile fusion measurement method is presented, integrating phase-measuring deflectometry with active tactile sensing. The vision subsystem supplies relative surface phase-gradient information, whereas the tactile subsystem provides absolute positional measurements; this combination resolves the gradient-height ambiguity and suppresses ghost-fringe artefacts produced by light deflection at the lower glass surface. An experimental setup comprising a Realsense D435 depth camera and a UR10 robotic arm was implemented and evaluated on planar and near-planar glass specimens. Results demonstrate that the proposed method enables accurate perception and reconstruction of both planar and near-planar transparent glass surfaces. Relative to a depth-camera approach augmented by a developer agent, the proposed method reduced RMS error by (80.59%) for concave surface reconstruction and by (96.33%) for convex surface reconstruction. The approach exploits the robot's inherent vision-tactile capabilities to achieve three-dimensional measurement and localization of transparent glass, offering a practical solution for robotic perception and reconstruction of transparent surfaces.
摘要:To overcome the limitations of traditional fringe-based displacement inversion algorithms in vortex interferometry for micro-displacement measurement, a deep-learning fusion model based on conjugate vortex beam interference is proposed. A YOLOv8s-Seg segmentation network, incorporating a lightweight FasterNet backbone and a CARAFE dynamic upsampling module, is employed to segment petal regions in interference images accurately, thereby reducing the influence of background noise and beam distortion on phase information extraction. A 14-layer convolutional neural network (CNN) is then used to perform multi-scale hierarchical feature extraction on the segmented petal regions, establishing a precise mapping between morphological variations and rotation angles to enable sub-nanometer displacement detection. Experimental results within a displacement range of (0-500) nm demonstrate a petal-region segmentation mean average precision (mAP) of 96.5%, overall displacement accuracy better than 0.94 nm, and a mean absolute error (MAE) of 0.63 nm. Owing to the dual-network collaborative architecture, the proposed method exhibits improved robustness to fringe distortion and noise, providing marked advantages in both precision and stability for micro-displacement measurement.
摘要:In digital holographic imaging, ring noise produced by the diffraction of microscopic scatterers is nonlinearly amplified into structured phase errors during numerical reconstruction, thereby limiting the accuracy of quantitative phase imaging and three-dimensional reconstruction. While speckle-noise suppression has been extensively studied, systematic theoretical modeling and targeted suppression strategies for ring noise remain underdeveloped. A novel convolutional neural network, FUResNet, is proposed to operate jointly in the spatial and frequency domains. A multi-scatterer diffraction-field superposition model is formulated to accurately simulate ring-noise formation. FUResNet integrates Fourier neural operators, a residual-learning architecture, and attention mechanisms to suppress ring noise efficiently while preserving essential holographic features with high fidelity. Experimental evaluation on simulated and experimental holograms demonstrates that FUResNet significantly outperforms existing approaches: background-noise standard deviation is reduced by 73.9%, peak signal-to-noise ratio (PSNR) is increased by 13.46 dB, and structural similarity index measure (SSIM) is improved by 13.9%. These improvements across noise suppression, image fidelity, and structural preservation indicate that FUResNet provides an effective solution for high-accuracy quantitative phase imaging.
摘要:With the rapid expansion of the flexible display industry, represented by foldable smartphones, simultaneous measurement of deformation and stress distribution across multiple structural layers under bending has become a critical challenge for structural design and performance evaluation. A color multi-channel optical measurement system, integrating multi-channel Digital Image Correlation (DIC) with fluorescent labeling and the screen’s own display, is presented to enable, for the first time, synchronous measurement of deformation and strain fields in multiple structural layers of a foldable screen during dynamic bending.The display layer produces red speckle patterns via intrinsic luminescence, while the surface protective layer is endowed with blue fluorescent speckles by spray-coating a UV-excited powder, enabling non-destructive speckle application compatible with mass-produced flexible screens. Incorporation of green fluorescent powder into intermediate structural layers during manufacturing further permits synchronous measurement of additional layers. Color-speckle images are captured simultaneously by a color camera system and spectrally separated. Full-field deformation and strain distributions for each structural layer are then computed independently using DIC algorithms. The system attains in-plane and out-of-plane deformation measurement accuracies of 1 μm and 5 μm, respectively, satisfying the high-precision requirements of multilayer material characterization in flexible-screen design and testing. Experimental results confirm that the proposed method accurately and synchronously retrieves deformation and strain fields for each layer of a flexible display, offering an innovative, non-destructive testing tool for reliability assessment of flexible displays.
摘要:To overcome the limited electromagnetic-interference resilience and poor adaptability of conventional approaches, an ultrasonic detection method based on AuNPs-reinforced nanocomposite photoacoustic sensing was developed for high-precision microcrack detection in HRB400 steel reinforcement bars used in high-speed rail sleepers. Au-PDMS films with Au nanoparticle concentrations of 4.01 wt%, 5.23 wt%, 6.01 wt%, and 7.69 wt% were fabricated, and their photoacoustic conversion characteristics were characterized. Ultrasonic signals were generated by a 532 nm pulsed laser and processed using a hybrid algorithm combining Butterworth bandpass filtering and db4 wavelet decomposition. A finite-element model of HRB400 reinforcement was constructed in COMSOL Multiphysics to quantify the relationship between multidimensional ultrasonic features and crack depth. Experimental results indicate that the 5.23 wt% Au-PDMS sample exhibited a dominant frequency of 4.58 MHz and a signal-to-noise ratio of 19.56 dB, achieving a measured crack-depth detection resolution of 640 μm. Quantitative analysis showed an increase in first-wave amplitude for 1 mm deep cracks, whereas 3 mm deep cracks produced waveform splitting into a dual-peak structure with a peak interval of 1.50 μs. A multiparameter synergistic response model integrating peak amplitude, energy, dominant frequency, and time-of-arrival enabled quantitative microcrack assessment. The proposed system provides micron-level resolution, strong immunity to electromagnetic interference, and adaptability to complex environments, offering reliable technical support for structural health monitoring of high-speed rail infrastructure.
关键词:photoacoustic sensing;ultrasonic detection;HRB400 steel reinforcement bar;multiphysics field simulation;microcrack growth
摘要:The conventional laser-triangulation method is limited to axial distance measurement; its lateral resolution is influenced by surface microstructure, and measurement accuracy typically remains at the micrometer scale. These limitations restrict applications such as obtaining the absolute shape (diameter and microstructure) of rotating workpieces in machine tools from a single axial-distance measurement. The present study introduces a novel method for simultaneous measurement of orthogonal two-dimensional velocity and distance of moving objects. An edge-detection-based distance measurement approach that is robust to speckle noise is also proposed to enhance applicability in high-precision industrial measurements. The method integrates the Scheimpflug principle with laser-triangulation sensors and establishes a theoretical mapping model that relates object lateral motion, axial surface variations, and variations in the imaging spot characteristics. Algorithms are developed on the basis of geometric optics and speckle statistics. Digital image correlation is employed to capture displacements of the speckle pattern’s internal texture, while the Canny operator combined with a Zernike-based subpixel edge-detection algorithm is used to track light-spot edge dynamics in real time. These techniques enable concurrent measurement of lateral velocity and axial position of moving surfaces. Experimental results demonstrate relative errors and uncertainties on the order of 10-4. Lateral measurement resolution achieved via edge detection is improved by an order of magnitude, and axial measurement accuracy reaches the submicron level. The proposed methods extend the measurement capabilities of laser-triangulation sensors and provide technical support for investigations of multi-degree-of-freedom dynamic phenomena, including motion mechanics and fluid dynamics.
摘要:To address the issue of the directional sensitivity of conventional shearography, a phase manipulating bidirectional shearography technique is proposed. This technique regards imaging, shearing, and phase-shifting as the phase transformation of the object wave. First, two Fresnel diffraction lenses are used to generate two laterally displaced images, forming shearograms. Then, by dynamically loading the dual-lens phase masks with different phase baselines on the liquid crystal spatial light modulator, phase-shifted shearograms are generated, and the temporal phase-shifting method is adopted for phase retrieval. The results indicate: the phase manipulating bidirectional shearography can adjust the shearing direction and amount, and introduce controllable temporal phase shifts. When using conventional shearography to reconstruct the deformation phase, the error in the non-shearing direction is 3.5-4.6 times that in the shearing direction. While using bidirectional shearography to reconstruct the deformation phase, the error levels in both shearing directions are similar and the error deviation is 8%. The phase manipulating bidirectional shearography technique has the characteristics of simple structure and high integration, providing an optical interferometry solution with single-wavelength, single-polarization, single-camera, single-aperture for high-precision deformation measurement.
摘要:Digital speckle pattern interferometry (DSPI) is a real-time, whole-field, and non-contact optical measurement method that has been widely applied in the field of non-destructive testing. However, the original phase maps obtained from DSPI measurements are often corrupted by speckle noise, which can compromise the accuracy and reliability of the subsequent phase unwrapping process. Therefore, there is a pressing need for an adaptive filtering method that can improve filtering performance and enhance the applicability of DSPI in complex application scenarios. In this paper, we propose an adaptive path-seeking filtering method for speckle fringes. The method first employs YOLOv8 to automatically identify and locate speckle fringe regions, reducing the calculation of invalid areas. Then, combined with the peak feature analysis, the optimal sampling path is dynamically planned to enhance the characterization of complex fringe structures. Finally, a local variance entropy (LVE) evaluation model is established based on B-spline fitting, enabling quantitative assessment of filtering smoothness while effectively preserving critical phase jump information. Experimental results show that the proposed method exhibits excellent filtering performance and automation capabilities across various scenarios, providing reliable support for the engineering applications of DSPI.
摘要:The accuracy of laser stripe center extraction critically determines the precision of structured-light vision measurements. In an online structured-light turnout-parameter measurement system, variations in stripe position due to turnout movement and environmental disturbances produce uneven stripe brightness and width, degrading measurement accuracy. To address these issues, an adaptive extraction method for the stripe center is proposed based on an improved Steger algorithm, offering enhanced environmental robustness and high precision. The method first isolates the effective stripe region using Otsu thresholding combined with a Two-Pass algorithm to suppress stray-light interference and accelerate computation. The stripe skeleton is then extracted and initial center points are refined. A neighborhood geometric normal-direction computation is introduced to determine the stripe cross-sectional width. By correlating the measured stripe width with the Gaussian kernel parameter σ, the convolution-kernel size is adaptively adjusted, yielding an accurate sub-pixel centroid of the stripe. Evaluation on a standard calibration block demonstrates an average measurement error within 0.09 mm. The proposed adaptive approach exhibits strong anti-interference capability and high accuracy, making it suitable for online measurement of turnout parameters.
摘要:To mitigate the loss of high-frequency surface texture information and the resulting reduction in reconstruction accuracy in deep learning-based photometric stereo, a multi-layer multi-element feature weight adaptive fusion 3D reconstruction network (MMF-Net) is proposed. The network architecture builds on PS-FCN and incorporates a symmetric encoder–decoder to enhance feature learning, representation capacity, and multi-level feature integration. A novel multi-element convolution layer with independent inter-layer adaptive weights is introduced; by incorporating additional trainable weights, both shape and texture cues are jointly leveraged to better capture fine surface texture variations, thereby improving stability and accuracy in scenes containing dense high-frequency information. An auxiliary skip-connection mechanism is also employed to propagate intermediate-layer features to later stages, preserving high-frequency details while reinforcing low-frequency structure, and enabling effective fusion of multi-band (high- and low-frequency) surface information.The method was evaluated on the DiLiGenT benchmark. MMF-Net attains an average mean angular error (MAE) of 6.94°, representing a 6% improvement over PS-FCN (Norm) at 7.39°For objects exhibiting pronounced high-frequency surface detail, the average reconstruction error is 11.03°, a 12% improvement relative to FUPS-Net at 12.52°. The results demonstrate that MMF-Net effectively captures both low- and high-frequency surface information in photometric stereo, offering a viable approach for high-precision 3D reconstruction from surface normals.
摘要:Phase retrieval in digital holographic microscopy contends with unwrapping errors induced by noise and phase distortions arising from aberrations. Traditional sequential approaches are constrained by limited computational efficiency and error propagation, motivating the development of synchronous solution paradigms. A multi-spectral channel U-Net (MScU-Net) is proposed for phase retrieval in digital holographic microscopy. The network embeds a Transformer-enhanced multi-spectral channel attention mechanism within a ResU-Net framework, enabling end-to-end nonlinear mapping that simultaneously performs phase unwrapping and aberration compensation directly from noisy, distorted wrapped phase maps. Experimental results demonstrate substantial improvements: peak signal-to-noise ratio (PSNR) attains 29.82 dB, structural similarity index measure (SSIM) is maintained at 0.96, and background noise standard deviation (0.000 4-0.003 0 rad) is reduced by 82.6%-95.8% relative to a state-of-the-art method. Step-height measurements show a systematic deviation of ≤3.74% from white-light interferometry references, with local measurement fluctuations reaching sub-nanometer precision (s = 0.42 nm). These findings indicate that MScU-Net offers an effective synchronous solution for accurate micro and nanoscale 3D topography measurement.
摘要:To address the limited high-frequency displacement capture capability and poor adaptability of traditional digital image correlation (DIC) methods that rely on fixed subsets, a strain–displacement synchronous prediction network based on the Swin Transformer is proposed. The model comprises two subnetworks, ST-DIC-d (displacement prediction) and ST-DIC-s (strain prediction). A hierarchical encoder–decoder Swin Transformer is employed for multi-scale feature extraction, enabling effective capture of local and global image features via attention mechanisms and skip connections to recover the displacement field. A trainable strain computation layer then derives strain components directly from the predicted displacement field. Evaluation on the DIC Challenge dataset shows that ST-DIC reduces the average absolute error in vertical displacement prediction by 21% relative to traditional DIC and CNN-based approaches. In tensile experiments, ST-DIC attains an 8% improvement in maximum strain accuracy within high-gradient regions and yields more finely resolved measurements. The proposed method demonstrates enhanced reliability and accuracy for measuring complex deformations.
摘要:Although trichromatic digital shearography is resistant to disturbances and insensitive to rigid-body motion, its application in high-temperature environments is hindered by interference from self-emitted thermal radiation and by its inherent limitation to measuring displacement gradients rather than direct 3D deformation. To overcome these constraints, a tri-color, tri-aperture digital shearography method is proposed for 3D deformation measurement at elevated temperatures. A tri-color tri-aperture diaphragm enables independent narrow-band filtering of each optical channel, effectively suppressing interference from the object's spontaneous thermal emission. The displacement field is reconstructed using a composite trapezoidal integration scheme, allowing direct recovery of the 3D deformation. Experimental results indicate a minimum measurable displacement of 30 nm, demonstrating effective acquisition of 3D deformations at high temperatures, successful suppression of thermal-radiation interference, and high-precision 3D measurement capability.
摘要:A single-camera, dual-prism panoramic three-dimensional digital image correlation (3D-DIC) method was developed to enable full 360° measurement of internal surface deformation and to evaluate its effectiveness for internal morphology characterization of circular pipes and pipeline defect detection. A single camera in conjunction with a double-prism optical arrangement is employed to reproduce a stereoscopic (dual-camera) imaging effect by refracting light through two prisms oriented at a prescribed angle, allowing simultaneous capture of left and right views. Panoramic observation of the entire inner surface is achieved via reflection from a convex mirror, providing continuous 360° coverage. Subsequent digital image correlation processing and coordinate transformation are performed on the acquired images to reconstruct the three-dimensional displacement field and strain distribution. Morphology experiments indicate a maximum absolute error of 0.4 mm, with the majority of measurement points exhibiting errors within 0.1 mm. Deformation tests show a maximum relative error of 3.86% in comparison with strain gauge measurements. The proposed system demonstrates high accuracy and practicality, achieves simplified hardware through optical design, and enables high-precision measurement of inner pipe-surface deformation.