1 of 5

Autonomous Apple Harvesting with Immersive Human-Robot Interaction

By Chris Ninatanta

2 of 5

Background

Photo by Elaine Thompson / AP, via NPR (March 18, 2020)Source: “Fruit Pickers Are Scarce, But Farmwork Hasn't Changed Much In A Century” by Dan Charles, NPR.org

WSU

  • The apple industry is crucial to Washington State’s economy.

​

  • Labor shortages, costly seasonal workers, and narrow harvesting windows threaten its sustainability.

​

  • Orchard owners often leave fruit still on the trees.

3 of 5

Current Problem

WSU

​

​

  • Current prototypes deployed in the field struggle to harvest >60% of available fruit even in well-maintained/ideal conditions.

​

  • Dense foliage, clustered apples, and branches reduce performance.

​

​

4 of 5

Proposed Approach

WSU

​

​

  • Human-AI collaboration via virtual reality (VR).

​

  • Decisions and movements gathered in simulated and in-orchard environments can train robots through immersive interactions.

​

  • Paired with a haptic device the user can receive feedback from the robot side.

5 of 5

Impact and Future Vision

WSU

  • Aim is to increase the current harvesting rate of autonomous systems from 60% to 80%.

​

  • Reduced reliance on seasonal/temporary workers.

​

  • This method works for more fruit, such as pears, cherries, and grapes bringing autonomous solutions to more than just apple growers.