Robotic Roommates Shopping for and Preparing Bavarian Breakfast

In the first part of the video below, you can see TUM-James, a PR2 Beta Programm robot, and TUM-Rosie cooperatively preparing the traditional Bavarian Weisswurst Frühstück (Bavarian Sausage Breakfast). TUM-Rosie is collecting the sausages, putting them into the pot with boiling water, waiting for them to be cooked and, finally, finding and getting them out of the pot into the serving bowl. TUM-James is meanwhile slicing the french baguette using a regular electric bread slicer and in the end serving the sausages and the bread to the class of highly regarded roboticists.
In the second part of the video, TUM-James is shown simulating the shopping task, bringing the groceries home and placing them to the places they are meant to be stored in.
It uses 3D perception algorithms from PCL in order to detect object candidates in the storage rack and ODUfinder system to recognize them. Grasping and manipulation
of the shopping basket is done using James’s haptic capabilities. Finally, to infer where do the objects belong to, TUM-James queries KnowRob system and computes the maximum WUP similarity (aka relatedness) to the other objects in the kitchen’s ontology.

By Intelligent Autonomous Systems Group at Technische Universität München
http://www.ias.cs.tum.edu

See the long and annotated versions of the video here:
Breakfast-part: http://www.youtube.com/watch?v=_SIUCrmE8J0
Shopping-part: http://www.youtube.com/watch?v=JS2zycc4AUE

Song:
“Marbert Rocel: Cornflake Boy (Solomun Vocal Remix)
(P) & © 2008, Compost Records
Musik/ Text: Panthera Krause/ Marcel Aue/ Antje Seifarth
Verwendung mit freundlicher Genehmigung der Universal Music Publishing Germany und Compost Medien GmbH & Co. KG

Video and editing: Michael Karg ( http://www.michikarg.de )

Duration : 0:1:28



Posted

in

by

Comments

25 responses to “Robotic Roommates Shopping for and Preparing Bavarian Breakfast”

  1. NewAgeDirector Avatar
    NewAgeDirector

    Great video keep up …
    Great video keep up the? good work.

  2. brooklyninja Avatar
    brooklyninja

    @UDKoder hahah
    ?

    @UDKoder hahah
    ?

  3. UDKoder Avatar
    UDKoder

    EXTERMINATE! …
    EXTERMINATE! EXTERMINATE!?

  4. chabi3000 Avatar
    chabi3000

    Hahahaha through …
    Hahahaha through our intelligence and creativity we men won´t need women no more . We will have cookbots for making our meals , a cleanbot for cleaning our rooms and even a fembot for sexual pleasure 😀 hahhahaha . Women? women .

  5. goodgoodgoodful Avatar
    goodgoodgoodful

    If Bruno Mars’ ” …
    If Bruno Mars’ “The Lazy Song” is to? be remixed, these robots really fit in the music video 🙂

  6. rivlean8 Avatar
    rivlean8

    @gregorstuhlbein …
    @gregorstuhlbein now did it ever? occur to you ever learning that you dont get paid for sitting your at home doing nothing?

  7. gregorstuhlbein Avatar
    gregorstuhlbein

    @rivlean8
    Did it …

    @rivlean8
    Did it ever occur to people that not having a job might be a good thing, at least
    when most work is done by robots? for them?

  8. rivlean8 Avatar
    rivlean8

    @TheSlackerboy and …
    @TheSlackerboy and in 20 years we humans gona have no more job
    probably in 40 years they gona have robots to? our womens for hours instead of us doing it lol

  9. captainferr Avatar
    captainferr

    Was the robot able …
    Was the robot able to recognize that? it dropped a sausage?

  10. foxyd3 Avatar
    foxyd3

    It is nice to see …
    It is nice to see they are? using Ubuntu Linux.

  11. TheSlackerboy Avatar
    TheSlackerboy

    @rivlean8 I …
    @rivlean8 I strongly suspect they will be cooking fast food long before they are cooking for the rich, they seem to be perfectly suited to small simple menus.

    I fear fast food jobs will become mostly robotic? within 10 years.

  12. AFLoneWolf Avatar
    AFLoneWolf

    So we’ll have YOU …
    So we’ll have YOU GUYS to blame when the robots take over the world.

    Eh.? Worth it.

  13. humaner Avatar
    humaner

    I want to be a …
    I want to be a robot.. perfect calculations..means perfect happiness?

  14. danagamer Avatar
    danagamer

    this is? what you …
    this is? what you get when you invest tax money into education instead of military

  15. rivlean8 Avatar
    rivlean8

    slow or? not, in 10 …
    slow or? not, in 10 years these robots gona cook dinner for rich ppl
    and in 20-30 gona be everywhere for every1

  16. jadayMisha Avatar
    jadayMisha

    ? ! ?????? ????
    ? ! ?????? ????

  17. kiko19972 Avatar
    kiko19972

    how much was the …
    how much was the video in original size? 20 Minutes? *NO OFFENCE SKYNET*?

  18. sspencer0383 Avatar
    sspencer0383

    @iasTUMUNICH: …
    @iasTUMUNICH: There’s obviously a limit to how fast the robots could perform such a task. How fast do you think these robots could complete this task (ignoring cooking? time)? What what would be the limiting factors? I know that the arms used in Rosie have good dynamic properties (high bandwidth), but I tend to think of the PR2 (James) as very clumsy (stiff and slow). However, I’m guessing that the dynamics of the robots are not one of the limiting factors yet.

  19. karolis685 Avatar
    karolis685

    I wonder when will …
    I wonder when will robots be capable of producing more complex dishes and also? be available for mass production 🙂

  20. itsGazaIan Avatar
    itsGazaIan

    @rhynobots I wasn’t …
    @rhynobots I wasn’t answering your question,? idiot.

  21. robertomasymas Avatar
    robertomasymas

    why are they …
    why are they wasting their time with robots that? shop for you? people do that for fun. make me a robot that cleans my bathroom for me, and does my laundry. now that would be a useful technology!

  22. RandomRaptor679 Avatar
    RandomRaptor679

    that’s one Fkiin’? …
    that’s one Fkiin’? very expensive toaster!

    “679”

  23. Exalion27 Avatar
    Exalion27

    PR2 didn’t even …
    PR2 didn’t even throw any bowls onto the ground!? Brilliant work!

  24. neonguru Avatar
    neonguru

    Catchy music? too
    Catchy music? too

  25. Hackzoid Avatar
    Hackzoid

    so skynet can cook …
    so skynet can cook now , brilliant ?

Leave a Reply