Fellowship helps Cornell researcher improve personal robots

Ashutosh Saxena, assistant professor of computer science at Cornell University, has been named one of seven Microsoft Research Faculty Fellows for 2012. He hopes to use the fellowship to develop robots that can perform mundane household tasks and learn from past experiences.


Ashutosh Saxena, assistant professor of computer science at Cornell University, has been named one of seven Microsoft Research Faculty Fellows for 2012. As a Microsoft Fellow, Saxena will receive funding of $200,000 over two years to expand his effort to develop “personal robots” that can take over mundane household tasks and assist the elderly and disabled.

After scanning a room, a robot points to the keyboard it was asked to locate. It uses context to identify objects, such as the fact that a keyboard is usually in front of a monitor. Courtesy: Cornell University Personal Robotics Lab

As director of the Cornell Personal Robotics group, Saxena has developed learning algorithms that enable personal robots to perform household tasks such as unloading items from a dishwasher and placing items in a refrigerator. In Saxena’s Robot Learning Lab in Upson Hall, graduate students are teaching robots to learn and adapt to the cluttered environments of homes, hospitals and nursing homes and the highly unstructured behavior of the humans they work with.

For example, a robot in Saxena’s lab can be shown a series of coffee cups, notice what features they all have in common and learn to recognize the next coffee cup it sees, even if it’s slightly different, and pick it up by whatever sort of handle it has. Similarly, a robot can learn to scan an unfamiliar kitchen to find the sink, dishwasher and cupboards so it knows where and how to place the cups.

Understanding what humans are doing is harder, but the researchers have taught robots to observe humans and identify a number of common activities. The next step, Saxena says, is to link perceptions with actions so a robot could, for example, notice that a patient hasn’t taken his medicine, remind him, and bring the bottle to his bedside.

The Microsoft funding has enabled Saxena to purchase a PR2 robot from Willow Garage, a company devoted to creating hardware for personal robotics research. Both Saxena and Willow Garage are proposing to make the results of this research freely available.

The new robot, dubbed “Kodiak,” is mobile, has two arms and, most importantly, provides feedback on the amount of force its hands exert so it can, for example, pick up an egg, or even slice a cucumber. 

Saxena, who joined the Cornell faculty in 2009, received his B.Tech. from the Indian Institute of Technology Kanpur in 2004 and his M.S and Ph.D. from Stanford University in 2006 and 2009, respectively. 

Saxena's Cornell page:


Video demonstrating Kodiak's capabilities:


- Edited by Chris Vavra, Control Engineering, www.controleng.com 

See more about machine control at controleng.com/machinecontrol.

No comments
The Top Plant program honors outstanding manufacturing facilities in North America. View the 2013 Top Plant.
The Product of the Year program recognizes products newly released in the manufacturing industries.
The Engineering Leaders Under 40 program identifies and gives recognition to young engineers who...
A cool solution: Collaboration, chemistry leads to foundry coat product development; See the 2015 Product of the Year Finalists
Raising the standard: What's new with NFPA 70E; A global view of manufacturing; Maintenance data; Fit bearings properly
Sister act: Building on their father's legacy, a new generation moves Bales Metal Surface Solutions forward; Meet the 2015 Engineering Leaders Under 40
Cyber security cost-efficient for industrial control systems; Extracting full value from operational data; Managing cyber security risks
Drilling for Big Data: Managing the flow of information; Big data drilldown series: Challenge and opportunity; OT to IT: Creating a circle of improvement; Industry loses best workers, again
Pipeline vulnerabilities? Securing hydrocarbon transit; Predictive analytics hit the mainstream; Dirty pipelines decrease flow, production—pig your line; Ensuring pipeline physical and cyber security
Upgrading secondary control systems; Keeping enclosures conditioned; Diagnostics increase equipment uptime; Mechatronics simplifies machine design
Designing positive-energy buildings; Ensuring power quality; Complying with NFPA 110; Minimizing arc flash hazards
Building high availability into industrial computers; Of key metrics and myth busting; The truth about five common VFD myths

Annual Salary Survey

After almost a decade of uncertainty, the confidence of plant floor managers is soaring. Even with a number of challenges and while implementing new technologies, there is a renewed sense of optimism among plant managers about their business and their future.

The respondents to the 2014 Plant Engineering Salary Survey come from throughout the U.S. and serve a variety of industries, but they are uniform in their optimism about manufacturing. This year’s survey found 79% consider manufacturing a secure career. That’s up from 75% in 2013 and significantly higher than the 63% figure when Plant Engineering first started asking that question a decade ago.

Read more: 2014 Salary Survey: Confidence rises amid the challenges

Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Society for Maintenance and Reliability Professionals an organization devoted...
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.