ResearchResearch paperReinforcement Learning · Robotics & Embodied AI1 source · Oct 11, 2026

Kinematic Reward, Measured Effort: Hardware-Validated RL Morphology Optimization of a Planar 2R Manipulator

We present a reinforcement-learning framework with RSL-RL PPO that optimizes the morphology of a 2R SCARA-type manipulator arm with Yoshikawa's kinematic manipulability index as a core reward, and the analytically derived closed-form optimum for the circular task is used to verify that our method recovers it.

Key points

  • Yoshikawa's Manipulability Index is generally used as a classical measure to define an optimal morphology of a manipulator.
  • However, any such optimization is almost always studied as a purely kinematic quantity in simulation and is rarely validated on hardware.
  • The RL-optimized morphologies are then transferred to a 2R hardware manipulator to validate its effect in reduction of joint load in the hardware.
  • Compared to the worst morphology, the optimum morphology delivered by our method reduces second joint load by 38.4 +/- 0.6% for the ellipse path and 41.3 +/- 0.3% for the rectangle, and first joint load by 15%.

Sources (1)

  • [1]Kinematic Reward, Measured Effort: Hardware-Validated RL Morphology Optimization of a Planar 2R Manipulator
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 11, 04:37 PM
    We present a reinforcement-learning framework with RSL-RL PPO that optimizes the morphology of a 2R SCARA-type manipulator arm with Yoshikawa's kinematic manipulability index as a core reward, and the analytically derived closed-form optimum for the circular task is used to verify that our method recovers it.
    Yoshikawa's Manipulability Index is generally used as a classical measure to define an optimal morphology of a manipulator.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 11, 2026FARL: A Fully Automated Pipeline of RL Interface and Solver Design
  2. Oct 11, 2026PointWalker: Mapless Quadruped Locomotion Directly From Raw LiDAR Point Clouds
  3. Oct 10, 2026Metric-Driven Reinforcement Learning for Object Hallucination Reduction in LVLM-Based Image Captioning
  4. Oct 10, 2026CFG-Policy: Unified Diffusion Policy Learning Framework via Classifier-free Guidance
  5. Oct 10, 2026From Video to Vision: Learning Generalizable Humanoid Carrying from Human Motion
  6. Oct 9, 2026Visualizing the World Model in an Agent's Value Function

Related