7 April 2009

Robots get science lesson

Using the digital mind that guides their self-repairing robot, there is now a computer program that uses raw observational data to figure out fundamental physical laws.

A new algorithm can distill fundamental natural laws from mere observations of a swinging double pendulum and other simple systems.

Without any prior instruction about the laws of physics, geometry, or kinematics, the algorithm driving the computer’s number crunching was able to determine the dynamics of the swinging, bouncing, and oscillating of the devices from specific fundamental processes, said Cornell University Researcher Hod Lipson and his doctoral student Michael Schmidt.

The algorithm deciphered in hours the same Laws of Motion and other properties that took Isaac Newton and others centuries to realize.

The new breakthrough is really not that far away from Lipson’s earlier work to develop Starfish, a robot with a “self-image” that could repair itself when damaged.

“The way the robot managed to recover from damage was to create a dynamical model, a self-image,” said Lipson. “It then used that model to make predictions about itself.”

A dynamical model is a mathematical representation of the way in which a system’s components influence each other over time.

If a robot can create dynamical models from data about itself, why not attempt to model the surrounding world as well, said Lipson and Schmidt.

When Lipson and Schmidt experimented with that approach, they learned their algorithm was re-discovering laws known to scientists and engineers, suggesting the algorithm should help uncover new laws for data sets less well understood.

“What is fascinating is that in the same way a robot created a dynamical model of itself using robot pieces, we now can create models not from motors and joints, but from components of mathematical objects, like variables, symbols like + and -, and other mathematical operators and functions,” Lipson said.

While the algorithm can work with almost any data set, for this experiment Lipson and Schmidt used motion-capture data of pendulums and oscillators, similar to the motion capture techniques used for movie special-effects. The researchers then fed the data to a computer running the new algorithm, a process modeled on the one driving their Starfish robot.

The computer began its analysis with a broad suite of mathematical building blocks, expressions the computer could combine to recreate patterns in the data set. Using a computational process called symbolic regression, a process inspired by biological evolution, the computer then took the assemblage of expressions and matched them against each other to find the look that reflected the data. The goal was to find those aspects of the data that were invariant, that did not change from one observation to the next.

“When you look at a pendulum, for example, some things go up, some go down,” said Lipson. “But to recognize that when something goes up another specific thing always go down to keep the total sum constant, this is a key to understanding the observations in a deeper sense, such as recognizing the laws of conservation.”

The computer retained the mathematical expressions that were invariant and abandoned those that were not, leaving a set of expressions that matched the data set and predicted future behavior. Because such a process could find patterns that are merely coincidental, the new algorithm also contains a critical step that compares subcomponent expressions, evaluating invariant equations to show they are meaningful and represent actual natural laws, proof the results are truly predictive.

Ultimately, a human still has to take the final list of a dozen or so expressions and figure out what they reflect in reality. An example of that are expressions describing a motion or energy-conservation law, or something totally new. Humans are still critical to the process: The computer serves as a data miner to find the laws, but a human must interpret them and give them meaning.

“Physicists like Newton and Kepler could have used a computer running this algorithm to figure out the laws that explain a falling apple or the motion of the planets with just a few hours of computation,” Schmidt said, “but a human still needs to pick the appropriate building-blocks and framework, as well as give words and interpretation to laws found by the computer.”

For related information, go to www.isa.org/manufacturing_automation.