Interactive (Adj.) - capable of acting on or influencing each other

Interact (Verb) - act together or towards others or with others

Human-computer interaction (HCI) - the study of interaction between people (users) and computers. It is an interdisciplinary subject, relating computer science with many other fields of study and research. Interaction between users and computers occurs at the user interface (or simply interface), which includes both hardware (peripherals and other hardware) and software (for example determining which, and how, information is presented to the user on a screen).

Does a computer User interact with computer software? Is it an interaction??

Rodney Brooks from MIT claims that interaction between 1) a program, and 2) the world taking place during the computation, plays a key role that cannot be replaced by any set of inputs determined prior to the computation. In the case of artificial intelligence interaction can be viewed as a prerequisite for intelligent system behavior.

The concept of interaction entails some type of behavioral novelty. Intelligent behavior therefore respectively encodes and reflects the qualitative and quantitative aspects of the environmental states “taking place” during an interaction.

An environmental state is a function of a previous environmental state and the occurrence of one or more events.

State1 —> event —> State2

State1 —> event -> event —> State2

Note also that distinct causes have distinct effects, and as such there are many potential initial states that, upon the occurrence of a distinct event, become State2.

StateA —> event1 —> State2

StateB —> event2 —> State2

StateC —> event3 —> State2

Interestingly, using a thermodynamics-based model, upon reaching State2 one is unable to determine from which previous state one arrived.

In most all cases, a person (usually a domain expert) identifies those environmental states or changes that warrant or necessitate a system response. A computer programmer (who also may serve as a domain expert wrt software creation, testing, debugging, etc.) reflects on the pertinent environmental states, and distinguishing and symbolizing each for use in a computer model.

Computer software developed in such a manner lacks the type of intelligence described by Brooks. Why is that the case? The person who considers which environmental states warrant or necessitate a system response is in fact applying a qualitative assessment in determining such. And while such an approach explicitly accounts for the quantitative aspects of an environmental state, any qualitative considerations remain implicit, the person consciously focusing on distinguishing the environmental states quantitatively.

The issue resides in the way in which environmental states are symbolized. Those states that warrant or necessitate a system response, afford a qualitative sense to the person so making the determination. Only after such an affordance does the person ascribe a symbol reflective of the quantitative (objective) aspects of an environmental state. The symbol selected fails to encode for the qualitative considerations that led to the determination that the environmental state warrants a system response.

This qualitative regime must be modeled and incorporated into computer systems to connect the abstract quantitative symbols to the situation being represented. The qualitative aspects afforded by such a situation are what connect people to the environment in which they live. So too must it be the case with any sensitively adaptive intelligence.

Applying these concepts to web applications leads to the concept of Web2.U.

If you’re interested in this qualitative model please email me.

And as always, your comments are invited.

Much Thanks.

In the futuristic cartoon series “The Jetsons,” a robotic maid named Rosie whizzed around the Jetsons’ home doing household chores–cleaning, cooking dinner and washing dishes.

Such a vision of robotic housekeeping is likely decades away from becoming reality. But at MIT, researchers are working on a very early version of such intelligent, robotic helpers–a humanoid called Domo who grasp objects and place them on shelves or counters.

A robot like Domo could help elderly or wheelchair-bound people with simple household tasks like putting away dishes. Other potential applications include agriculture, space travel and assisting workers on an assembly line, says Aaron Edsinger, an MIT postdoctoral associate who has been working on Domo for the last three years.

Edsinger describes Domo as the “next generation” of earlier robots built at MIT–Kismet, which was designed to interact with humans, and Cog, which could learn to manipulate unknown objects. Domo incorporates elements of both of those robots.

“The real potential of robots in the future is going to be realized when they can do many types of manual tasks,” including those that require interaction with humans, Edsinger said.

There are now plenty of robots doing manual work on factory assembly lines, but those machines follow a script and can’t learn to adapt to new situations, as Domo can, said Rodney Brooks, director of MIT’s Computer Science and Artificial Intelligence Laboratory.

“Robots in an automobile factory manipulate objects, but they do the same thing, along the same path, every time,” Brooks said. “If robots are ever going to be truly useful, they need to be able to manipulate the objects we manipulate.”

LIVING IN THE REAL WORLD

Edsinger’s team, overseen by Brooks, decided to focus on making a robot that can function in a real human environment–in someone’s kitchen, for example. Robots that are designed to help people in their homes will have to be able to ignore the clutter found in most environments and focus only on certain stimuli, says Edsinger.

“Typically robots are placed in very restricted worlds because then you can control the environment. If you put a robot in someone’s home, that approach just doesn’t extend to that,” he said. “We want the robot to adapt to the world, not the world to adapt to the robot.”

Perched on a table in Edsinger’s workspace, Domo can “see” everything going on in front of it. As the robot’s large blue eyes roam across the room, cameras feed information to 12 computers that analyze the input and decide what to focus on.

Domo’s visual system is attuned to unexpected motion, allowing it to focus on important stimuli within human environments. For example, locating human faces is critical for social interaction, and people are often in motion. When Domo spots motion that looks like a face, it locks its gaze onto it.

Edsinger recently demonstrated how Domo can interact with people to help them accomplish useful tasks.

Once he captures Domo’s gaze, they exchange greetings. “Hey, Domo,” Edsinger says, to which Domo responds, “Hey, Domo.” “Shelf, Domo,” says Edsinger, prompting the robot to find a shelf. Domo looks around until it spots a nearby table that looks promising. The robot reaches out its left hand to touch the shelf, much like a person groping for a light switch in the dark, to make sure the shelf is really there.

Once Domo has located the shelf, it reaches out its right hand towards Edsinger, who places a bag of coffee beans in the open hand. Domo wiggles them a little to get a feel for the object, then transfers the bag from its right hand to its left hand (nearest the shelf). Domo then reaches up and places the bag on the shelf.

Though it seems like a minor movement, wiggling the object is key to the robot’s ability to accurately place it on a shelf, Edsinger says. Domo is programmed to learn about the size of an object by focusing on the tip of the object, for example, the cap of a water bottle. When the robot wiggles the tip back and forth, it can figure out how big the bottle is and decide how to transfer it from hand to hand or to place it on a shelf.

“You can hand it an object it’s never seen before, and it can find the tip and start to control it,” Edsinger said.

THE HUMAN CONDITION

The philosophy behind the team’s approach is that humans and robots can work together to accomplish tasks that neither could do all alone.

“If you can offload some parts of the process and let the robot handle the manual skills, that is a nice synergistic relationship,” Edsinger said. “The key is that it has to be more useful or valuable than the effort put into it.”

For Domo or any robot to safely interact with humans, the robot has to be able to sense when a human is touching it. Domo has springs in its arms, hands and neck that can sense force and respond to it. If you grab its hand and push, the robot will move the way you want it to.

“By placing that spring in there, you get physical compliance that makes the whole body sort of springy, which makes it safer for human interaction,” Edsinger said. But if you apply too much force or move Domo’s arms in the wrong direction, it voices its displeasure by saying “ouch.”

If robots are going to be useful in the home, it’s also important for them to have a humanoid form, so people will feel more comfortable around them.

Such assistive robots could be very useful in finding solutions to the impending health care crisis caused by the aging of the baby boomers, Edsinger said. Having help with simple tasks, such as getting a glass from a cabinet, could make a big difference for elderly or wheelchair-bound people.

The original work on Domo was funded by NASA, and the project is now supported by Toyota, which is interested in developing partner robots for the home. Another application is in assembly line production. The idea is that intelligent robots could work together with people to make workers more productive and save manufacturing jobs from being sent overseas, says Edsinger.

Although a life of leisure enabled by robots who perform all manual labor is still securely in the realm of science fiction, Brooks says he can foresee a future where robots specialized for different functions help out with household chores.

“I don’t think there’s going to be one Rosie the robot doing everything in the home,” said Brooks. “It’s more likely to be a team of robots doing different things.”

Adapted from an MIT press release.