When people get together in a room and work towards a shared goal, magic starts to happen. Minds get aligned, a shared vision is built and a feeling of togetherness fills the room – but the global introduction of remote work in 2020 left many people longing for this magical interhuman experience.

Goal

This project explores how human connections can be enabled in remote space so that remote collaboration becomes an empowering act instead of an limiting substitute.

Context
4 weeks UID Professional Product Course,
Collaboration with Konftel
Teammates
Linda Kraft
Romy Koppert
Ruoyun Wang
My responsibilities
Interaction Design
Experience Design
Storytelling

Introducing Human Magic

Human magic is a term we coined during our research to describe what is currently missing during remote collaboration — or rather to describe what connects us when we share the same space collaborating with other people.

Human magic is the engagement we feel in the room when everyone is pulling in the same direction.
Human magic is the energy people radiate when they talk about something they're passionate about and it ignites the passion in others.
Human magic is what elevates collaboration to a new height and enables teams to achieve greatness.

To bring this sense of Human Magic to the remote space, we rethought the way we communicate and collaborate in a remote team setting.

In this new remote setting, each team member has the same setup. Team members are split across seperate screens, each of which is equipped with a camera and an array of speakers just meant and representing this particular person.

Through this setup, conversational acts that are otherwise limited to physical meetings become visible again.

Eye contact
By placing a camera on the screen, people virtually look each other in the eye when talking. This eye contact makes conversations more personal and connecting.

Body language
Through the portrait-orientation of screens, body language gets across and gives people the power to express themselves more clearly.

Directionality
The camera in each screen captures implicit head-turning and makes it clear who is attending whom.

How it works

Each team member has an identical setup of n-1 separated screens (n = amount of team members). The team members are arranged around a 'virtual round table', which determines which team member occupies which screen.

Team members are arranged around a virtual round table spatial factors become effective.

When team member Magenta turns to the screen of their team member Blue, it looks to the other team members (who are observing the situation with the camera of their screen) as if the two team members are actually turning to each other.

When Magenta is turning to the right to speak to Blue's screen, it appears for the other two team members in the backgrouns as if Magenta is in fact speaking to the adjacent screen.

Dec 2020

The process of designing for magic

For our process, we combined a series of ethnographic research with subsequent experience prototyping.

Interviews

Qualitative remote interviews revealed that people couldn't describe what they were missing in remote work compared to their previous co-located settings. To them, it was nothing specific but more the 'magic' that occurs when people get together in a room.

We used this 'magic' as a reference point and metaphor to map, explore and describe the dynamic that is happening when people communicate and collaborate in a physical space.

We concluded that the this 'human magic' is enabled through physical conversational acts such as mutual eye contact or body language. To explore how this dynamic could brough to remote space, in a next step we engaged in bodystorming and experience prototyping where we replicated current remote work settings and technology.

Experience Prototyping

Through bodystorming and experience prototyping sessions, we explored the effects of current remote technology on conversational acts such as eye contact or body language and how these acts — and the human magic' — could be enabled again.

Frame orientation
The common landscape-orientation of current screens limits what is visible and perceivable of a person. By rotating the frame, body language becomes visible again.

Camera placement
Current remote technology doesn't allow for natural eye contact. By relocating the camera to eye-level, natural eye contact is enabled which bonds you with the person you're talking to.

Spatial factors
Because current remote technology displays every video participant on a single screen which also contains the camera, it is hard to follow conversation flows because the position of a person in space is cannot be perceived. By seperating participants across multiple screens, mutual gaze and natural head-turning becomes possible again and makes the conversation flow visible.

Conclusion

The experience prototyping sessions exposed different smaller building blocks each of which improved remote communication in some way. In a next step, we formulated these smaller building blocks into single coherent concepts.

Consolidation

In a next step, we consolidated our multiple smaller findings and buildings into single concepts and build more advanced prototype with which we reenacted a remote work scenario.

Concept

During our experience prototyping, the separation of video participants across multiple screens turned out to be strong and we decided to use it as the core for our concept. Through a more advanced prototype, we further explored and validated this separation.

By hooking up webcams to Laptops and building dummy screens as a reference point for the other team members, we prototyped the experience across 'seperate rooms'.
By filming the conversation from a POV perspective, we captured the experience of the conversation across separate screens.

Bringing Human Magic to Stakeholders

To convey the concept of Human Magic to our collaboration partner and convince them of our findings, we shot a experience video in which we used a dinner scene with friends to capture the feeling of togetherness, human magic and what it means to get together with people in a physical space.

Experience clips

We used the dinner setting of the experience video as a bridge to communicate our concept. Through small looped video clips we tried to make the experience of our concept graspable.

Conversation flows
The seperation of screens and camera makes it natural to follow conversation flows and who is attending whom.

Conversational acts
The separation of screens and cameras allows natural conversational acts such as leaning in to talk to the other person.

Pointing
The separation of screens and cameras makes it possible to point at people to engage them in conversations.

Body language
Portrait orientation of the screen allows to express oneself naturally through body language.

Eye contact
Eye contact during conversations creates intimacy and replicates a natural conversational act.

Role in Team

The entire project was highly collaborative and, especially in the initial research and exploration phase, ideas were fluidly built upon from each other.
In the team, I had an important role in conceptualizing the prototypes and communicating our final concept. For example, I was responsible for the idea of the short video clips and their realization in After Effects. I was also responsible for directing and producing the final hero imagery.

Learnings and Challenges

One of the biggest challenges of the project was that the pandemic prevented us from bringing in external people to enange with us in experience prototyping or to validate our results. Since we only had ourselves to test, we had to take every step carefully so as not to blindly fall in love with our own ideas.
My personal learning from the project is the experience-heavy approach. For example, in the beginning I was not a fan of the idea of pursuing "Human Magic" as a metaphor because I found it too abstract. However, I quickly realized the strength of Human Magic and how valuable it is for storytelling and conveying the concept.