Robot Manipulation

Robot manipulation is the engineering of machines that grasp, move, and alter physical objects with an arm and hand.

15 frameworks, from 1948 to today · Robotics · Engineering

still a working view ended · each leads to its entry below

Overview

Robot manipulation is the engineering of machines that grasp, move, and alter physical objects with an arm and hand1. Its central problem is contact: a robot arm must position itself precisely enough to touch the world, then manage the forces that arise when it does. Unlike a machine tool that cuts a fixed path, a manipulator must cope with objects whose weight, shape, and friction it may only partly know. The field's history is a sequence of attempts to answer one question—how much of the world should the machine be told about in advance, and how much should it discover through sensing and control? Each era's answer shaped what robots could do, from spraying car bodies to folding laundry.

Teleoperators and the Master–Slave Arm

The field begins not with autonomy but with distance. In the 1940s, workers handling radioactive material at the Argonne National Laboratory needed to manipulate hazardous substances behind shielding23. The mechanical master–slave manipulator, developed by Ray Goertz and colleagues and refined through the 1950s, let an operator move a handle on one side of a wall while a linked arm on the other side reproduced the motion. The "master" was the human-controlled input; the "slave" was the remote output. Mechanical linkages transmitted position directly, so the operator felt the load through the handle.

The limitation was reach and flexibility: mechanical linkages were heavy and could not span long distances. In the mid-1950s Goertz and his team at Argonne built an electrically powered, servo-controlled manipulator, the E-1, in which sensors measured the master's position and motors drove the slave to match it. This was teleoperation—remote operation through a control loop—and it introduced a problem that would recur for decades: the operator could see the slave but could not feel what it touched unless force feedback was engineered back through the master. The master–slave idea also set the vocabulary of the field: a manipulator is a chain of joints and links ending in a hand or tool, and its job is to place that hand where work must be done.

The First Industrial Arms and the Geometry of Motion

In 1961, George Devol's patent and Joseph Engelberger's company Unimation produced the Unimate, installed at a General Motors plant in New Jersey to unload die-casting machines. The Unimate was a hydraulic arm that repeated a stored sequence of joint positions4. It did not sense the world; it trusted that the world would be where it was told. This was teach-and-playback: a human physically guided the arm through a motion, the controller recorded joint angles, and the arm replayed them. It worked because the factory was engineered around the robot—parts arrived in fixed positions, and the arm's job was to be exactly repeatable.

The problem this approach could not solve was reach and orientation. A serial arm's hand position depends on all its joint angles in a complicated way, and engineers needed to compute where the hand would be, or what joint angles would put it at a desired point. The mathematics of this—kinematics—was systematized in the 1950s and 1960s. Jacques Denavit and Richard Hartenberg published in 1955 a convention for assigning coordinate frames to each link of a chain, so that the transformation from one joint to the next could be written as a standard matrix5. The Denavit–Hartenberg parameters became the common language for describing arm geometry. Given the parameters, one could solve forward kinematics—joint angles to hand position—by multiplying matrices6. The inverse problem, finding joint angles for a desired hand pose, was harder and often had multiple solutions, but closed-form solutions existed for common geometries such as the six-joint spherical wrist arm.

Dynamics came next. An arm's motion is governed not only by geometry but by inertia, gravity, and the forces between links. The equations of motion for a serial chain were derived in the 1970s and 1980s, and the computed-torque control method—using the dynamic model to calculate the torques needed for a desired acceleration—became a standard way to make an arm track a trajectory accurately. The Stanford Arm, designed by Victor Scheinman in 1969, was an early electrically driven six-joint arm built for research and used to demonstrate computer-controlled manipulation, including inserting a peg into a hole under force sensing.

Compliance, Force, and the Problem of Contact

Position control assumes the arm knows where the world is. Contact breaks that assumption: a rigid arm commanded to move into a surface will either stop or push with whatever force its motors produce, and small errors in position become large errors in force. In the 1970s and 1980s, researchers confronted this directly. The key insight was that a manipulator in contact should control force or compliance rather than position alone.

Two approaches competed. Hybrid force/position control, formalized by John Craig and Raibert in the early 1980s, divided the task space into directions where position is controlled and directions where force is controlled—for example, sliding along a surface while pressing into it7. Impedance control, developed by Neville Hogan in the mid-1980s, took a different view: rather than switching between position and force, the controller makes the arm behave like a spring-damper system with a chosen stiffness, so that contact forces arise naturally from displacement. Hogan argued that this matched how biological limbs interact with the world. The remote center of compliance, a passive mechanical device developed by Drake and others at MIT in the 1970s, solved the same problem without electronics: a compliant wrist that lets a peg self-align during insertion. These ideas made assembly tasks—peg-in-hole, turning a crank, wiping a surface—tractable for robots, and they remain the basis of force-controlled manipulation today.

Grasping and the Dexterous Hand

Parallel to arm control, a separate line of work asked how a hand should hold an object. The mechanics of grasping were studied in the 1980s and 1990s: a grasp is stable if the contact forces can resist external disturbances, and the set of forces a grasp can exert is characterized by its friction cones and force closure. Matthew Mason and J. Kenneth Salisbury's work at MIT, including Salisbury's 1982 design of the Stanford/JPL hand—a three-fingered, tendon-driven hand—connected grasp theory to hardware. The BarrettHand, a later three-fingered gripper, and the Utah/MIT hand of the 1980s explored tendon-driven, multi-fingered designs.

The gap between theory and practice was large. A human hand has many degrees of freedom and rich tactile sensing; robot hands of the era had few sensors and fragile mechanisms. Simpler grippers—two-finger parallel jaws—dominated industry because they were robust and cheap. The dexterous hand remained a research object, and the field learned that grasping is not only a geometry problem but a sensing and control problem: the hand must detect slip, modulate force, and adapt to objects it did not model.

Uncertainty, Perception, and Planning

By the 1990s, the limits of pre-programmed motion were clear. A robot that must pick objects from a bin cannot know each object's exact pose; a mobile manipulator cannot assume the world is fixed. Probabilistic methods entered manipulation from the wider field of probabilistic robotics89. Particle filters and Kalman filters estimated object poses from noisy sensors; grasp planning under uncertainty computed grasps that were likely to succeed given a distribution over object positions rather than a single estimate. The insight was that a good grasp is one that works across the range of plausible poses, not just the nominal one.

This shifted the field's center of gravity toward perception and planning. Manipulation became a pipeline: sense the scene, estimate object poses, plan a grasp and a motion, execute, and check. Each stage had its own literature, and the pipeline's fragility—errors in one stage propagated—became a central complaint. The sense–plan–act architecture, inherited from broader robotics, was powerful but slow and brittle in cluttered, changing scenes.

Learning from Data and Demonstration

The most recent turn is learning. Instead of hand-coding models of objects and contacts, researchers began to let robots learn from demonstration or from their own experience10. Learning from demonstration—recording a human's motion and generalizing it—descends from teach-and-playback but adds generalization: a policy learned from a few demonstrations can adapt to new object positions. Reinforcement learning, in which a robot improves by trial and error, became practical for manipulation in the 2010s as simulation and GPU computing made large numbers of trials feasible. Deep learning brought visual perception into the loop: a neural network can map camera images directly to grasp points or motor commands, bypassing explicit object models.

The landmark demonstrations of the 2010s and 2020s—robots learning to fold cloth, assemble objects, or pick from cluttered bins—showed that data-driven methods could handle variation that classical pipelines struggled with. The open questions are the ones the field has always faced in new form: how to generalize beyond the training distribution, how to guarantee safety when the policy is a learned black box, and how to combine the reliability of model-based control with the flexibility of learning. The history of robot manipulation is a history of moving the boundary between what is told and what is discovered—and that boundary is still being redrawn.

References

  1. Manipulator (device), Wikipedia
  2. Raymond Goertz, Wikipedia
  3. Remote manipulator (History), Wikipedia
  4. Industrial robot (History), Wikipedia
  5. Denavit–Hartenberg parameters, Wikipedia
  6. Forward kinematics, Wikipedia
  7. Force control (History), Wikipedia
  8. Partially observable Markov decision process, Wikipedia
  9. Monte Carlo localization, Wikipedia
  10. Robot learning, Wikipedia

The frameworks of Robot Manipulation

Each framework is a way of working the field has used: when it held, and the question it answers.

  1. 1948-Present

    Remote manipulator

    How can a person handle material at a distance?

    Fly to its tower in Nousfarer

  2. 1955-Present

    Kinematic and Dynamic Modeling

    Where is the hand given the joint angles?

    Fly to its tower in Nousfarer

  3. 1961-1990

    Teach-and-Playback Programming

    How can a machine repeat a taught motion?

    Fly to its tower in Nousfarer

  4. 1970-Present
  5. 1976-1995
  6. 1981-Present

    Force control

    How should a robot press on a surface?

    Fly to its tower in Nousfarer

  7. 1982-Present
  8. 1982-Present

    Grasp Mechanics and Force Closure

    When is a grasp stable against disturbance?

    Fly to its tower in Nousfarer

  9. 1985-Present

    Impedance Control

    How should an arm yield when it touches?

    Fly to its tower in Nousfarer

  10. 1990-Present
  11. 1990-Present

    Sense–Plan–Act Pipeline

    How should sensing, planning and acting be ordered?

    Fly to its tower in Nousfarer

  12. 2000-Present

    Imitation learning

    How can a robot learn a skill from a person?

    Fly to its tower in Nousfarer

  13. 2010-Present

    Learning-based manipulation

    How can a robot learn manipulation from data?

    Fly to its tower in Nousfarer

  14. 2015-Present
  15. 2015-Present

How the ideas connect

Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.

Remote manipulatorKinematic and Dynamic ModelingTeach-and-Playback ProgrammingDynamics and Computed-Torque ControlPassive Compliance and Remote Center …Force controlGrasp Mechanics and Dexterous HandsGrasp Mechanics and Force ClosureImpedance ControlProbabilistic Manipulation under Unce…Sense–Plan–Act PipelineImitation learningLearning-based manipulationDeep Visuomotor and End-to-End Learni…Reinforcement Learning for Manipulati…

Beyond the field

Where Robot Manipulation's ideas came from in other fields, and what they led to there: the strongest 12 of 105 links.

A city in Nousfarer: a red-carpeted stair climbing terraces to a crowned tower on an acropolis, more towers round it, forest and snowy mountains beyond.
A city in Nousfarer, the game played in the browser.

Robot Manipulation is a planet in Nousfarer

Its city has a tower for each of these 15 frameworks. Land, walk in, and climb one concept at a time.

Land on Robot Manipulation

Related fields

Fields its ideas are linked to

More in Robotics

See where Robot Manipulation sits on the Map of Human Knowledge