My research focuses on bridging the reality gap in contact-rich physical interactions by proposing a unified data-driven abstraction framework. This approach decouples high-fidelity ground truth generation from runtime execution to resolve the fidelity-tractability trade-off.
Research Interests:
This research focuses on enabling real-time, high-fidelity simulation of contact mechanics for robotic manipulation. Standard rigid-body simulators use simplified contact models that fail to capture the complex deformation of soft sensors, while numerical solvers are too slow for online interaction.
will be submittedd Main Takeaway Video:
Methods: A Neural Physics Engine is developed using a geometry-aware Graph Neural Network. This network is trained on the high-fidelity dataset generated in the previous topic to predict full-field nodal deformations based on sparse contact primitives provided by a rigid-body simulator. The model acts as a fast proxy solver that injects soft-body physics into a rigid simulation loop.
Main Takeaway Takeaway The Neural Physics Engine achieves sub-millimeter accuracy in predicting deformation and runs significantly faster than traditional finite element solvers, enabling real-time simulation of contact-rich tasks. This capability allows for the zero-shot transfer of manipulation policies, such as peg-in-hole insertion, from simulation to the real world.
Links:
This work addresses the data scarcity issue in vision-based tactile sensing, where high-resolution visual data exists but lacks corresponding physical ground truth such as force and deformation fields. Existing simulators often prioritize visual realism over mechanical accuracy, limiting their utility for physically grounded learning.
Demo Video:
Methods A bidirectional data pipeline is established using a finite element model of a sensor that is rigorously calibrated to real-world indentation data. Two neural networks are trained on paired datasets: a perception network that infers dense physical states from real tactile images, and a rendering network that synthesizes photorealistic images from simulated physical states.
Main Takeaway The framework creates a closed loop between the visual and physical domains, enabling the automatic annotation of real-world tactile images with physical data and the generation of large-scale, physically grounded synthetic datasets. This resolves the labeling bottleneck for tactile perception tasks.
Links:
This research aims to resolve the trade-off between physical fidelity and computational speed in simulating soft robots for reinforcement learning. High-fidelity finite element method simulations are accurate but too slow for learning, while rigid-body simulators are fast but lack physical realism regarding deformation.
Demo Video:
Demo Video:
Methods The framework employs a data-driven surrogate modeling approach. A high-fidelity simulation is first calibrated to the real robot and then compressed using model order reduction to generate a training dataset. A transformer-based physics-informed neural network is trained to learn the forward dynamics from this data. This learned model is then mapped to a simplified virtual kinematic chain (surrogate) within a fast physics engine, enabling rapid policy training.
Main Takeaway The surrogate model successfully bridges the reality gap, allowing reinforcement learning policies trained in a fast simulation to transfer zero-shot to a physical soft manipulator for trajectory tracking and force control tasks. This method provides a scalable pipeline for training soft robots by decoupling accurate physics generation from runtime execution.
Links:
This research addresses the challenge of controlling soft manipulators constructed from origami cylinder modules, specifically those utilizing the Yoshimura pattern. While these structures offer lightweight and collapsible properties, their non-linear folding mechanics make traditional modeling computationally expensive and unsuitable for real-time control.
Demo Video:
Method The study derives a simplified kinematic model based on first principles, treating the actuator as a conservative energy system. The method decouples the deformation into axial and bending components, using geometric constraints and potential energy minimization to predict force and moment outputs. To enable real-time execution, these complex analytical relationships are precomputed into lookup tables, allowing the controller to rapidly infer strain and bending angles from pressure inputs and external loads.
Main Takeaway The proposed analytical model facilitates real-time, closed-loop position and force control of a soft manipulator using only embedded proprioceptive sensors, eliminating the need for computationally heavy finite element analysis during operation. However, the reliance on specific geometric patterns limits the generalizability of this approach to arbitrary soft body morphologies.
Links:
Email: ndolphin93@gmail.com
Lab: Soft Robotics and Bionics Lab, Seoul National University
Google Scholar: Page
For detailed publications list, please visit my publications page or download my CV.