in the video upon, you will see how to use the app. The video is cut after the picture of the fridge is taken because the Snapchat Spectacles are not able to capture textures from camera using the internal tool.
XRay is a snapchat spectacles app that enables you to snap photo of what's inside things. Later on, you don't need to open them again to see what's inside!
| Instructions | Pictures |
|---|---|
| Create an anchor and choose the according room in which you are |   |
| When you are linked to a room, a little icon of the room appears in the right up corner of your view |  |
| You can bring back the menu from anywhere by just putting your hand (either left or right) facing up |  |
| You can spawn xray frames around by clicking on the frame button |  |
| First pinch (with your right hand for now) to place the upper left corner |  |
| Second pinch (with your right hand for now) to place the bottom right corner. You will see the image growing up. |  |
| You can take a picture (or update it) in a frame by pinch and pull the photo button |  |
| After that, you will see the picture even when the object is closed, for example here, the fridge. |  |
You can create other rooms (anchors) and other xray frames in the rooms!
- the question button is here to open again the beginning frame with the video to help users understand what to do: a more detailed tutorial will be there in future versions.
- the anti-clockwise arrow enable the user to erase all local data (lost everything).
You need to be connected to Snap Cloud through Internet. This is required to store your pictures as the storage of a spectacles app is only around 125mb.
All your pictures are encrypted using AES CTR algorithm with unique keys/counter stored on device => so even the admin of the Snap Cloud database cannot view anything. Feel free to reuse the way a encrypt/decrypt images before sending them to Snap Cloud to ensure maximum security and data privacy in your apps! You can check the ImageTestEncrypt file that show how to use the code.
Anchors are used to set your xrays in the same space when you will run again the app.
- More apps should be design to be usable with one hand. Here, you can summon the menu by putting your hand face up. Then use the same hand to pinch the button.
- Data privacy implied to encrypt data before they're sent to the database (Snap Cloud). You can follow all the recommandations from OWASP.
- At the beginning, the app was using AI to spatialize pictures. It's fun, but nobody should share sensible pictures with AI... So for now the feature is disabled and will probably be reintroduced later by just taking stereoscopic pictures.
- Why pinch and pull buttons? This way, you can take full pictures without your hands in the field of view.
- Why not using the crop gestures (two hands pinch)? You don't want this gesture for big areas or furnitures on the ground as it is not comfortable. Simple pinch twice do the trick. Actually, the app sadly lack of a feedback for telling the user what to do, but it will be included in future versions.
- The resolution of pictures using the Camera API is not perfect, but using Image Request freeze a little the app and seems not compatible with the current encryption system... So the Image Request is disabled until performance and privacy can be setted up properly.
- Integrated tutorial
- Better feedbacks (palm face up to summon menu, creating frame, picture uploaded, ...)
- Close button on xray delete it (local and remote data)
- Button+Gesture to show/hide all xrays
- And some other surprises...
- The encrypting algorithm use aes-js@3.1.2 library customized with coroutine to not block the main thread during encryption
- Some icons are from the great Kenney.nl