Robotic Roommates Shopping for and Preparing Bavarian Breakfast

In the first part of the video below, you can see TUM-James, a PR2 Beta Programm robot, and TUM-Rosie cooperatively preparing the traditional Bavarian Weisswurst Frühstück (Bavarian Sausage Breakfast). TUM-Rosie is collecting the sausages, putting them into the pot with boiling water, waiting for them to be cooked and, finally, finding and getting them out of the pot into the serving bowl. TUM-James is meanwhile slicing the french baguette using a regular electric bread slicer and in the end serving the sausages and the bread to the class of highly regarded roboticists.
In the second part of the video, TUM-James is shown simulating the shopping task, bringing the groceries home and placing them to the places they are meant to be stored in.
It uses 3D perception algorithms from PCL in order to detect object candidates in the storage rack and ODUfinder system to recognize them. Grasping and manipulation
of the shopping basket is done using James’s haptic capabilities. Finally, to infer where do the objects belong to, TUM-James queries KnowRob system and computes the maximum WUP similarity (aka relatedness) to the other objects in the kitchen’s ontology.

By Intelligent Autonomous Systems Group at Technische Universität München

See the long and annotated versions of the video here:

“Marbert Rocel: Cornflake Boy (Solomun Vocal Remix)
(P) & © 2008, Compost Records
Musik/ Text: Panthera Krause/ Marcel Aue/ Antje Seifarth
Verwendung mit freundlicher Genehmigung der Universal Music Publishing Germany und Compost Medien GmbH & Co. KG

Video and editing: Michael Karg ( )

Duration : 0:1:28





25 responses to “Robotic Roommates Shopping for and Preparing Bavarian Breakfast”

  1. NewAgeDirector Avatar

    Great video keep up …
    Great video keep up the? good work.

  2. brooklyninja Avatar

    @UDKoder hahah

    @UDKoder hahah

  3. UDKoder Avatar


  4. chabi3000 Avatar

    Hahahaha through …
    Hahahaha through our intelligence and creativity we men won´t need women no more . We will have cookbots for making our meals , a cleanbot for cleaning our rooms and even a fembot for sexual pleasure 😀 hahhahaha . Women? women .

  5. goodgoodgoodful Avatar

    If Bruno Mars’ ” …
    If Bruno Mars’ “The Lazy Song” is to? be remixed, these robots really fit in the music video 🙂

  6. rivlean8 Avatar

    @gregorstuhlbein …
    @gregorstuhlbein now did it ever? occur to you ever learning that you dont get paid for sitting your at home doing nothing?

  7. gregorstuhlbein Avatar

    Did it …

    Did it ever occur to people that not having a job might be a good thing, at least
    when most work is done by robots? for them?

  8. rivlean8 Avatar

    @TheSlackerboy and …
    @TheSlackerboy and in 20 years we humans gona have no more job
    probably in 40 years they gona have robots to? our womens for hours instead of us doing it lol

  9. captainferr Avatar

    Was the robot able …
    Was the robot able to recognize that? it dropped a sausage?

  10. foxyd3 Avatar

    It is nice to see …
    It is nice to see they are? using Ubuntu Linux.

  11. TheSlackerboy Avatar

    @rivlean8 I …
    @rivlean8 I strongly suspect they will be cooking fast food long before they are cooking for the rich, they seem to be perfectly suited to small simple menus.

    I fear fast food jobs will become mostly robotic? within 10 years.

  12. AFLoneWolf Avatar

    So we’ll have YOU …
    So we’ll have YOU GUYS to blame when the robots take over the world.

    Eh.? Worth it.

  13. humaner Avatar

    I want to be a …
    I want to be a robot.. perfect calculations..means perfect happiness?

  14. danagamer Avatar

    this is? what you …
    this is? what you get when you invest tax money into education instead of military

  15. rivlean8 Avatar

    slow or? not, in 10 …
    slow or? not, in 10 years these robots gona cook dinner for rich ppl
    and in 20-30 gona be everywhere for every1

  16. jadayMisha Avatar

    ? ! ?????? ????
    ? ! ?????? ????

  17. kiko19972 Avatar

    how much was the …
    how much was the video in original size? 20 Minutes? *NO OFFENCE SKYNET*?

  18. sspencer0383 Avatar

    @iasTUMUNICH: …
    @iasTUMUNICH: There’s obviously a limit to how fast the robots could perform such a task. How fast do you think these robots could complete this task (ignoring cooking? time)? What what would be the limiting factors? I know that the arms used in Rosie have good dynamic properties (high bandwidth), but I tend to think of the PR2 (James) as very clumsy (stiff and slow). However, I’m guessing that the dynamics of the robots are not one of the limiting factors yet.

  19. karolis685 Avatar

    I wonder when will …
    I wonder when will robots be capable of producing more complex dishes and also? be available for mass production 🙂

  20. itsGazaIan Avatar

    @rhynobots I wasn’t …
    @rhynobots I wasn’t answering your question,? idiot.

  21. robertomasymas Avatar

    why are they …
    why are they wasting their time with robots that? shop for you? people do that for fun. make me a robot that cleans my bathroom for me, and does my laundry. now that would be a useful technology!

  22. RandomRaptor679 Avatar

    that’s one Fkiin’? …
    that’s one Fkiin’? very expensive toaster!


  23. Exalion27 Avatar

    PR2 didn’t even …
    PR2 didn’t even throw any bowls onto the ground!? Brilliant work!

  24. neonguru Avatar

    Catchy music? too
    Catchy music? too

  25. Hackzoid Avatar

    so skynet can cook …
    so skynet can cook now , brilliant ?

Leave a Reply