3/3/2020 | 3 MINUTE READ

Robots Get Hand-Eye Coordination

Facebook Share Icon LinkedIn Share Icon Twitter Share Icon Share by EMail icon Print Icon

Artificial vision, touch and intelligence help collaborative robots cope with the unpredictable.


Facebook Share Icon LinkedIn Share Icon Twitter Share Icon Share by EMail icon Print Icon

Connect at

Universal Robots USA will be exhibiting new technology at IMTS 2020 in Chicago this September.

Plan to meet up with their team or get registered here!

Although Modern Machine Shop focuses on CNC machining, the application pictured here is worthy of attention. Consider for a moment the difficulties inherent in automating a task like inserting Ethernet cables. A host of variables, from differing socket positions to the unpredictable flex of the cord to the level of force required to “snap” the connector in place, might stymie even the most carefully programmed robot. This robot is different in that it eschews careful programming entirely in favor of essentially controlling itself. It is capable of adjusting its approach as needed to ensure a snug fit regardless of the orientation or position of the socket.

Cable insertion aside, the broader implications of giving robots what is essentially hand-eye coordination are not difficult to imagine. If our mechanized coworkers can do this, might they one day help CNC machine shops manipulate a mix of different parts around active deburring tools, or perhaps pick workpieces at random from boxes without grids or other fixtures? Inspection, surface finishing, machine tending and possibly even applications that have yet to be explored all might benefit from such a system.

Featured Content

Automation in High-Mix, Low-Volume Turning Applications
Job Shop Automation: Fast, Simple and Agile

Developed in Germany by Micropsi Industries, this robot’s auxiliary control system is called MIRAI (Micropsi Industries Robotic Artificial Intelligence). Ituses cameras, force sensors and a neural network to approximate human senses and react to dynamic environments in real time. Rick Schoonover, who represents the company in North America, says some early applications already show good reason to extend ambitions beyond the electronics industry.

For example, one early use case is loading gears into a hobbing machine delicately enough to prolong the life of the arbor, he says. Another uses the system to trim large composite aerospace structures with a constant force level, regardless of the robot’s orientation or location relative to the part surface. Active investigations into picking and precisely placing a variety of different 3D-printed parts also illustrate the technology’s broad potential for automating low-volume, high-mix work.

Programmers don’t “teach” a MIRAI-driven cobot; they train it with skills. The process looks similar in that a human repeatedly guides the robot arm through the motions of the chosen task. However, the arm should approach the target from as many directions and angles as possible. This is because the focus of these machine learning algorithms is not the means to the desired end, but the end itself — cable in socket, for example.  As the robot moves, the cloud-based neural network processes the continuous stream of sensor data to gain an understanding of its environment and what is required to accomplish the task.

“If you want to put a peg in a hole, you’re not going to mathematically calculate and execute a sequence of motions,” Mr. Schoonover explains. “If you can see it, you can do it — there’s no path. You’re going to look at the peg, look at the hole, and stick the peg in the hole. If the hole moves, you can adjust to that and put the peg in anyway.”

For now, MIRAI controls the robot only for critical portions of a traditionally programmed path — at the moment of cable insertion, or perhaps gripping or nesting a part. At this point, the robot begins to move on its own based on its own “perception” as well as what it has “learned” about its goals and the natural variance in its environment.

Whether such technology ever makes its way to your shop floor, or whether it is ever employed for more than just micro-movements, remains to be seen. Regardless, technology like MIRAI is changing our understanding of what automation can be: flexible, easy to deploy, and now, apparently, tolerant of variation ranging from environmental disturbances to differences in part shape, position and geometry.


  • The Long And Short Of Bar Feeder Selection

    For many shops, the decision comes down to a 4- or 12-foot-capacity magazine-style bar feeder. Here are some guidelines for choosing between them.

  • What Is The Best Bar Feed System For Production Turning?

    Selecting the right bar feeder can be one of the most important decisions a shop can make. Bar feed systems help improve productivity, throughput and quality, but in order to achieve the most benefit from them it is essential that a bar feed system be matched to the particular needs of the turning operation.

  • Robots as Precision Machine Tools

    To remain competitive, high-end manufacturing companies are looking for accurate, reliable and maintenance-free machine tools offering fast change-over, programming and setup. Industrial robot technology could provide an excellent base for machining because it is flexible and affordable.