As a market leader in consumer experience, Selligent is always looking for innovative techniques to present to their clients. At the forefront of emerging technologies, Hololens has enormous potential add something special to marketing solutions. Selligent wanted to inspire their clients. They wanted to demonstrate how marrying their marketing system with a technology like HoloLens could enable their clients to connect with consumers in a fresh and original way.
Selligent has a history of working with Kazendi. Based on the excellent response we received from our collaboration at Digital Marketing Expo 2016 [link] and the Holocampaign [link], Selligent came to us. After project initiation we were in conversation with Selligent for 3 days. Together we defined our goals: - To demonstrate how fusing Selligent’s system and HoloLens could create exciting and innovative marketing campaigns for Selligent’s clients - To reinforce Selligent’s position as a digital leader and create PR opportunities Selligent was ready to engage their digital leader marketing technology in development. As always, Kazendi would bring our expertise in rapid prototyping and collaborative ideation to the table. We were ready to begin.
We chose to develop a prototype that would have benefits and applications in the retail sector, where many of Selligent’s clients operate. To really get the most out of HoloLens, we wanted to involve objects that rely upon spatial placement. The obvious choice was furniture!Additionally, we wanted to create a shared and interactive experience. While this is not native to the Hololens, this potential for users is huge – and we were well able to deliver this.Our key deliverables were: - Deliver a prototype for a future use case of Hololens that Selligent can present to its clients - Create an engaging experience that showcases the innovative power of Hololens - Include standups, documentation and source code Kazendi leveraged our intangible assets to develop a shared Holographic experience – and, we we able to offer Selligent the shortened development time of only one week. Additionally, in retaining control of the project, Selligent was able to benefit from our flexibility and responsiveness, including daily standups.
On the first day, we create the product backlog and started wireframing. We took inspiration from the UI & UX of the Holograms app native to the HoloLens and therefore decided to employ a similar bounding box feature for moving our holographic furniture. From our point of view, the HoloLens’ UX currently has a break where when selecting holograms from the Holograms app, the user position it via gaze and places it via an Airtap. When the user then wants to move a placed hologram via adjust mode, it is done so via an Airtap & Hold gestures therefore breaking with the interaction of positioning via gaze. We wanted to avoid this break and have decided to position objects via gaze.
Next, we reused our assets from the previous project HoloCampaign and started with the technical development. We decided that it would be helpful to have the shared gaze tracker in there to see where the other user is looking. We checked 3D libraries to see if we can buy a furniture collection but found the challenge that these were either had a too high polygon count or would not have a red thread running through.
We’ve got the first build to test ready and after the first round of testing noticed that when the users are standing close to each other, the gestures from user A are picked up by HoloLens B by accident…Since we quite like the Airtap interaction, we will manage this by distributing users during demos but as a solution could either use the remote or employ voice commands and only have the HoloLens listen to user audio and not room audio.
Having received the first samples from the 3D designer, the testing can begin. We focused first on testing the shared interaction, handing control of objects from one user to the next. The first bug was quickly found one when one user select a model and before it is placed, the other user taps on it. This causes the system to be confused about who is controlling the object - the fix is quick and entailed that we lock the control in certain situations.
The day before delivery is all about testing and polishing. We included audio feedback to give the user a confirmation for successful selection of items. One thing that we noticed from the day before is that the rotation feature is complex to use since it requires you to select the object to be rotate, hit the rotate button, focus back on the model and start the rotation using an air-tap and hold gesture. We include this as a medium priority task in our backlog for a future iteration and will have to think about how we can make it easier.
The big day has come and Max is on his way to Munich to present HoloLiving to the client. The first public demonstration will be at Year of The Monkey as part of Selligent’s representation there and we are already excited to introduce the attendees to their first shared holographic experience :)