Project 1: Breakfast In The Future

Platform: Android, PC (Windows)

Permissions Requested (Android Only): "Take pictures and record video" and "Access photos, media, and files on your device"

Run on Android

Download apk directly through mobile browser or FastHub; or download .apk file to a computer and transfer to your mobile device. Ensure "allow installation from unknown sources" is enabled (you may have to enable developer options in your settings menu), install and run. Print image targets and aim phone after assembling them. Or navigate to them in the GitHub repo and while running, aim phone at screen. While aiming your phone at the screen is the easiest way, it is less functional than printing/assembling the image targets. For full immersion, if your phone has a VR mode, run the app on your phone and thrown it in a cheap VR headset (like Google Cardboard) after making the image targets, it's worth the effort! 

Run on Windows

Download from GitHub, navigate to Builds/Windows, hook up webcam, make image targets, run the .exe file.

Overview (by Heather)

With our application, you will need many different objects. You will need the following objects to place in front of a webcam: Placemat 1, Placemat 2, Magazine 1, Magazine 2, Drink 1, Drink 2, Drink 3, Cereal 1, Cereal 2. All of these different objects create a different augmented reality once the webcam detects which one it is seeing. You can see a house with trees, an apple pie floating next to it, an animated chimney and water for cereal 1. For cereal 2, you will see a giant banana appear in the middle of a jungle with monkeys spinning circles with sound effects. For placemat 1, you will see pancakes being flipped with pancakes floating in the air. For placemat 2, you will see a breakfast menu and utensils set up around it. You will also hear sizzle sound effects for the pancakes. For can 1, you will see an animated orange mouth, and you will hear a voice speaking. For can 2, you will see a red energy drink overflowing, with volcanoes around and erupting sound effects. For can 3, you will see milk and hear a cow mooing. For can 4, you will see pineapples and see the can explode with flavor.

Discussion

This technology that we created could be used in various ways. We have thought of a few ways that this technology could be well used. One way that this technology could we well used is if you were having a themed breakfast! For example, a jungle themed breakfast. You could totally augment your reality by wearing AR glasses that had this technology, and when you looked at a cereal box you would see monkeys and bananas and hear jungle sounds. Or you could look at a cereal box, and see your vacation home! This could make your breakfast a lot more energetic, and fun. This technology could drive individuals to enjoy breakfast a lot more by augmenting their reality, making individuals actually excited to get up in the mornings. This technology would be a great source of entertainment to your early routine, and totally create dinner in a movie kind of feeling.


Another way that this technology could be well used is that it can help you interpret every name you see or every type of item you see sitting on your table during breakfast. This is a really fascinating idea! This technology could be somewhat of a learning tool. Imagine that you are wearing AR glasses, and you see things coming out of your oats! For example, you see bees flying around and you hear them buzzing. This can help you learn that honey from your oats comes from bees! That might seem like common sense to most people, but that is just a really simple explanation. This idea of wearing glasses that can make the things on your breakfast table become active and produce sounds really is helpful when it comes to learning. We are always using one of our five senses to learn whether that’s hearing, smelling, tasting, touching, or seeing. In this case, if we are wearing a pair of AR glasses that augment our breakfast table and teach us about what’s on the table we will be using at least two of those senses! This sort of technology could be well used as a learning tool because it saves so much time. The time that wearing these glasses at breakfast would save if you were trying to learn all about the items on the table would be next to nothing! Instead of opening up a computer, or pulling a browser up on a phone and physically typing a question you may have, these glasses will visualize it and add sound effects for you just by turning your head to that item! This is incredibly fast. Time consuming learning always seems to be such a pain, but with this technology you would literally have the information right before your eyes.


Another way that this technology could be well used is that it can help elderly people. As we get older our bodies age unfortunately. This totally sucks, and what is better than making our life easier?! This can technology can help the elderly see the objects on their breakfast table. The animations and sounds could help them immensely. It might be dangerous for them not to have a caregiver around, but this helps the caregiver be able to do other tasks like dishes while the elderly are eating breakfast. Suppose you have a group of elderly individuals sitting at a table eating breakfast, one can not see what that can over there was. In this case, it’s the volcanic energy juice! The pair of AR glasses they are wearing can produce animations and sounds for the can to be easier to recognize and see. They wouldn’t need to ask someone for help, if they were just wearing glasses that had this technology built into it. The technology built into AR glasses would help them immensely. This would help grumpy elderly people enjoy their mornings again because the items on the breakfast table could jump out at them.

    - Heather Kuhn

Sources

Enumerated list of the sounds that we used and their sources:

​

​

Links to all the source code and any assets (models, textures) that we used:

​

Animation -

Happy Pancake Day Animation Content for Placemat1 - Hays Travel - https://giphy.com/explore/february-pancake

Talking Orange Animation Content - https://giphy.com/gifs/blah-a14DgqlSI3lTO

Orange Liquid Pouring Animation Content - https://giphy.com/gifs/splat-nicksplat-aaahh-real-monster-l0DAGWTbsbk7LAdqg

Animated Unicorn Content for Drink_3 - Mauro Gatti - https://giphy.com/gifs/fun-party-smile-3o7btZjaYxqkGyOYA8

OJ Reaction - https://giphy.com/gifs/reactiongifs-nJ8nPKNeobMQ0

Bro whats that - http://thegiflibrary.tumblr.com/post/11546480351

Volcano - http://bestanimations.com/Nature/volcano-explosion-footage-animated-gif.gif

Magazine Cover - TIME Magazine - https://giphy.com/gifs/technology-time-magazine-never-offline-26tOY3KjQUL9YhRT2

​

Images -

Placemat 2 Sponsors - Tea Printers And Publishers - http://www.teaprinters.com/images/placemats/rocklandcafe.jpg

Placemat 2 Menu - Vector Stock - https://cdn4.vectorstock.com/i/1000x1000/81/18/menu-breakfast-restaurant-food-template-placemat-vector-11178118.jpg

pancake1 - https://www.thespruceeats.com/easy-vegan-pancake-recipe-3376597

pancake2 - https://www.eggs.ca/recipes/fluffy-pancakes

pancake3 - https://www.bettycrocker.com/recipes/pancakes/7b1b2ca4-2ce0-4d3c-932b-6855257e6e87

OJCanFloor - https://www.sportsgossip.com/other/oj-simpson-eats-at-ihop

Pineapple Skull - https://jackofthedust.com/products/pineapple-skull

Drink_4 Target - file:///C:/Users/Admin/Desktop/Unity%20Projects/Breakfast/Assets/Resources/Images/soda_can.pdf

Door Material - https://www.google.com/search?q=unity+door+texture&tbm=isch&tbo=u&source=univ&sa=X&ved=0ahUKEwjHurS9nqLZAhWprVkKHetEBroQsAQIJg&biw=1218&bih=885#imgrc=303bGPNIARz3AM:

Magazine Page magP1 - http://www.magazinedesigning.com/wp-content/uploads/2013/10/magazine-structure-link4.jpg

Magazine Page magP2 - http://2.bp.blogspot.com/-dxftsypTWME/T47d0fMEm8I/AAAAAAAAAR4/vMmLXDLedkI/s1600/Wakhan+Article+Bergen+Magazine+page+1.jpg

Magazine Cover magCover1 - https://ohmy.disney.com/wp-content/uploads/2013/08/Disney-Princess-Magazines-Rapunzel.png

Magazine Page magP3 - http://three-blocks.com/magazine-page/magazine-page-elegant-active-lifestyle-article-magazine-page/

Magazine Page magP4 - http://www.rosannaarquette.com/interview-in-westlake-magazine/rosanna-arquette-westlake-magazine-page-54-web-2/

Magazine Page magP5 - https://attemptedbloggery.blogspot.com/2014/03/seth-funny-dream.html

Magazine Page magP6 - http://drcoreygonzales.com/mag01.html

Magazine Page magP7 - https://www.designbold.com/templates/aBml0yxrmv/creative-photography-interior-design-layout-magazine-page-03.html

​

Scripts -

Code in animation script -  https://answers.unity.com/questions/429697/how-will-i-get-animated-gif-images-in-scene.html

ImageTargetPlayAudio - https://developer.vuforia.com/forum/faq/unity-how-can-i-play-audio-when-targets-get-detected

CreateCone.cs - http://wiki.unity3d.com/index.php?title=CreateCone

 

Models -

Palm Tree - Kim - https://free3d.com/3d-model/date-palm-2286.html

Banana - junglecat97 - https://free3d.com/3d-model/banana-23586.html

Chimp - 3dregenerator - https://free3d.com/3d-model/puo-42917.html

Cow - snippysnappets - https://free3d.com/3d-model/low-poly-cow-75171.html

Bee - umar6419 - https://free3d.com/3d-model/bee-89226.html

Bumble Bee Transformer - ysup12 - https://free3d.com/3d-model/bumble-bee-46016.html

 

Programs -

Gif Splitter - EZGIF - https://ezgif.com/split/

​

Instructions on how to build your application on the classroom PC:

Either double click the executable that corresponds to your device platform or open the project within unity editor






Items / Levels:

Cereal Box 1 - Grandma's Homemade Apple Pie Cereal


In this scene, the house is what pops up when the webcam finds cereal 1. The rest is a scene created around the box.

Cereal Box 2 - Banana Jungle Cereal


In this scene, the orange face on the can is what pops up when the webcam finds drink 1. The rest is a scene created around the can.

Drink 1 - OJ's OJ


In this scene, the orange face on the can is what pops up when the webcam finds drink 1. The rest is a scene created around the can.

Drink 2 - Volcanic Morning Energy


In the scene, the volcano on the can and the explosion coming out of the can is what pops up when it sees drink 2. The rest is a scene created around the can.

Drink 3 - Milk


In the scene, the milk can appears when the webcam sees drink 3. The spinning cow dumps all over the place. The rest of the scene is created around the can

Drink 4 - Pineapple Juice


// Note: Drink 4 currently uses Drink 3's image target and will not work on the version on GitHub. 

This will be fixed soon and Drink 4 will have its own image target. 9/25/18 9/29/18


Magazine 1 & 3 Side By Side - Better Towers and Gardens


In this scene, a page shows up when the webcam recognizes Magazine 1. There are two button on the pages that allows to flip between the cover and 4 pages.

Magazines 1 & 2 Side By Side - TIME Magazine


In this scene, a page shows up when the webcam recognizes Magazine 2. There are two button on the pages that allows to flip between 4 pages.

Placemat 1 - Pancakes


In this scene, you will see a pancake gif appear when the webcam sees placemat 1. The rest is a scene created around the placemat.

Placemat 2 - Breakfast Menu


In this scene, you will see a breakfast menu appear when the webcam sees placemat 2. It flips between two images for animation. The rest is a scene created around the placemat.