UniReflex: Plug-and-Play Force Control for Pre-trained Generative Policy via Fast-Slow Reflex Coupling

Yan Huang1,† Shoujie Li2,† Ziwu Song1,3 Wenbo Ding1,4,*
1Tsinghua University Shenzhen International Graduate School    2Nanyang Technological University
3X Square Robot    4Xspark AI
Tsinghua University Nanyang Technological University X Square Robot Xspark AI

Equal contribution    *Corresponding author


Abstract

Generative imitation learning policies excel at trajectory planning but lack closed-loop force regulation, while existing force-aware adaptations typically require costly retraining. We present UniReflex, a plug-and-play framework that endows frozen generative policies with active force control without backbone fine-tuning. By non-invasively intercepting deep latent representations from the action head, UniReflex drives a fast reflex network that decouples active force exertion from external interaction response. Inspired by human muscle co-contraction, this scheme predicts anisotropic stiffness for genuine active force exertion. Furthermore, UniReflex integrates an adaptive gating mechanism that enables seamless transitions between position-dominant planning and force-dominant execution. Real-world bimanual experiments demonstrate that UniReflex significantly improves contact stability and success rates while preserving original position accuracy. Notably, our approach achieves 25–66× lower per-step backward latency relative to joint training strategies on the evaluated backbones.


Introduction & Taxonomy

Generative imitation policies are typically position-based planners without closed-loop wrench regulation. UniReflex introduces a separately trained fast reflex that reads internal trajectory representations from the frozen slow policy and closes the loop on force at a high rate.

This section places UniReflex in the broader landscape of force-control methods. Existing approaches either add force as another policy output, rely on task-specific hybrid controllers, or train fast auxiliary modules together with the main backbone. UniReflex follows a different route: it keeps the pre-trained generative policy untouched and adds a lightweight reflex layer that translates its latent intent into contact-aware force regulation.

Taxonomy of force control methods
Category Representative methods Force
ctrl.
Closed-
loop
Variable
stiff.
Ref.
force
Plug-
play
Fast-only
training
Variable impedance control
Guided Control ACP Active
Hybrid P/F Control ForceVLA2 Active
Force-conditioned imitation learning
Force-aware DP FoAR Passive
Force-aware VLA TA-VLA, ForceVLA Passive
Fast-slow systems
Tactile-reactive DP RDP Passive
VLA-diffusion hybrid RoboDual Passive
UniReflex (Ours) Active

UniReflex uniquely enables active, variable-stiffness control while remaining plug-and-play with frozen generative policies via fast-only training.


Method

UniReflex Architecture. We hook the deep feature map of the generative action head to extract an intent tensor. The reflex GRU consumes proprioception and this intent tensor to emit reference poses, reference wrenches, and stiffness encodings for decoupled force control. The system operates in a tri-rate closed loop: slow visual planning, fast reflex prediction, and PID force tracking.

The key idea is to separate what the robot should do from how contact should be regulated. The frozen policy continues to provide semantic motion intent from vision, while the reflex module reacts to high-frequency proprioception and contact signals. During free-space motion, the controller prioritizes pose tracking; after contact is detected, the gate shifts authority toward force and stiffness regulation.

UniReflex system overview

The system diagram shows the full fast-slow coupling: latent features from the slow generative policy condition a reflex network, which predicts reference motion, desired wrench, and anisotropic stiffness for the low-level controller. This lets UniReflex respond to contact much faster than the visual policy can re-plan.


Experiments

We evaluate five contact-rich bimanual benchmarks with frozen generative backbones (DP, \(\pi_0\), DreamZero) and force-aware baselines (RDP, ForceVLA, TA-VLA). Only UniReflex is trained; the slow policy stays frozen.

Following the paper, results are organized around six questions:

Evaluation tasks

Five tasks cover sustained wiping, peeling, insertion, and impact/flip. Phase I is approach/alignment; Phase II is force-regulated contact.

Q1–Q2 Success rates on contact-rich benchmarks
Table 2 success rates

Q1. Phase I stays within ~10 points of each frozen backbone; Phase II rises by 20–60 points on sustained-contact tasks. Q2. Against RDP / ForceVLA / TA-VLA, UniReflex keeps planner-level Phase I quality and matches or exceeds the best monolithic Phase II numbers.

Q3–Q4 Ablations and recovery
Table 3 component ablations

Q3. Stiffness / wrench / gating ablations under frozen DP.

Table 4 recovery

Q4. Dynamic recovery 80–100% (0.87–1.28 s); TCP-bias Phase II 70–90%.

Q4–Q5 High-frequency reflex and force tracking
High-frequency reflex and force tracking

Q4–Q5. Fast corrections under disturbance; peel-force tracking closer than frozen baselines; measured \(F_x,F_y,F_z\) aligned with UniReflex references.

Q6 Training throughput
Table 5 training throughput

Q6. Training only the fast GRU gives about 25–66× lower per-step backward latency than joint fine-tuning, while updating only 0.188–0.375% as many parameters as the backbone.


Robot demonstration videos

We present 5 evaluation tasks. Each row corresponds to one task, featuring 3 columns: (1) Frozen backbones, (2) Force-aware baselines, and (3) UniReflex with different backbones. Use the left/right arrows or the dots below to switch between the 3 videos in each column.

These videos are meant to make the table results concrete. Frozen backbones often generate plausible motion but fail once contact must be maintained. Force-aware baselines can react to force, but may lose position precision or require tighter coupling with the policy. UniReflex aims to keep the backbone's motion plan while adding the fast corrections needed for stable physical interaction.

1. Flip Chip Box
2. Plug Charger
3. Peel Note
4. Wipe (Curve)
5. Wipe (Incline)

Force-centric evaluation clips

Comparison of force-centric execution. Use the arrows to switch between frozen backbones, force-aware baselines, and UniReflex.

This comparison focuses on the moment of contact rather than the full task rollout. The important difference is not only whether the robot reaches the target, but whether it can apply force smoothly without bouncing, stalling, or drifting away from the intended motion.

Frozen backbones: DP, \(\pi_0\), DreamZero


Reference Force Tracking

Q5. UniReflex predicts a task-dependent reference force instead of relying on a fixed contact heuristic. The tracking clip shows how the measured wrench follows this reference during execution, which is the mechanism behind the observed contact stability in the manipulation tasks.


High-frequency reflex response

Q4. The fast reflex runs at a higher rate than visual policy inference, so it can respond to disturbances while the slow planner continues to provide the global trajectory. This clip emphasizes the temporal advantage of the fast-slow design: corrections happen at the contact timescale, not only at the next camera-driven action update.