Prototype/Outcome

We had 2 aspects of our outcome: the physical prototype and the voice prototype.

Physical

What we created

 To start off, the user writes their personal information on a paper.  The user reaches through the hand hole to place the piece of paper on the platfrom. A camera mounted within the system will take a picture of the text. Then, I press a button that triggers a motor system to unravel a string. The string is connected to the platform so unraveling it causes the platform to tilt down. The paper then falls into the pit simulating your inforamtion being "eaten up."

Tools and technologies involved

To build the structure I laser cut plywood and I used DC motors for the motor system. I designed the pieces and structure using solidworks.

Technology

What we created

The camera takes a pictures of text and the text is parsed using computer vision. This "persoanl information" along with a prompt is fed to chatGPT, which then outputs a response. A text-to-speech algorithm is used to read this prompt out loud. The user then responds to the voice assist with whatever they want and this is converted to text using a speech-to-text algorithm. This text along with a prompt is again fed to chatGPT for a response and the same process repeats until the user stops responding.

Tools and technologies involved

Much of the code that is being used for this project is sourced from Google’s sample code. Because all of the AI aspects of the project excluding ChatGPT is done through Google Cloud, I found sample documents on GitHub demonstrating how to implement the desired functionality in Python. The code that I wrote was mainly to tie all of the functionalities together. Needed to set up a custom environment for Google’s libraries and their requirements, as well as a Google Cloud account on a free trial. The services in Google Cloud cost money, so I’ve been using credits I received as a part of the free trial.