Creating Your Virtual Dream Environment for Other People to Get In and Explore Your Dream

Step 1 – Talk to people

Interview Record

Main questions:

  1. Under what conditions do you dream most?
  2. Do you think your dreams represent some of your memory or what will happen in the future?
  3. Do you interested in understand other one’s dreams?
  4. Did you talk with your family or friends about your dream? And what is the most impressive dream?
  5. Do you want to use your dream world to express another side of yourself and release your pressure.
  6. Do you want to share your dream contents with others? And allowed others to get into your dream and leave some messages?
  7. Do you want to record your dream? And may be look back it?


  1. Yumeng Shi – 23 years old
  2. Hanyu Tan- 25 years old
  3. Qingqing Wang – 21 years old
  4. Yueqin Ni -28 years old
  5. Sophia Cai – 24 years old

Step 2 – Immerse yourself

1. research topics and talks about psychology and brain dreams


This Ted Talk represent the relationships between our brain dreams and psychology. Many of us will experience some kind of trauma during our lifetime. Sometimes, we escape with no long-term effects. But for millions of people, those experiences linger, causing symptoms like flashbacks, nightmares, and negative thoughts that interfere with everyday life. Joelle Rabinow Maletis details the science behind post-traumatic stress disorder or PTSD.

2. talk with  Proessor Mark Skwarek in IDM program about the AR and Motion Capture, and trying to figure out how can new technology and new media help to realize a better virtual dream world.

Step 3 – Method hunting

This project is about Dream Content and Political Ideology. This study focuses on the relationship of dream content and political ideology in a contemporary U.S. context. The study involved 56 people, 28 (14 male and 14 female) who identified themselves as members of the political right and 28 (14 male and 14 female) who identified themselves as members of the political left.

I feel like it is a useful method and I would like to survey different people in different ages and different psychologic status and then analyze the content of their dreams and trying to find some interesting comments in their dreams. The method analyzes the ideology information, and the aim of it is to explore the relationships between dreams and humans memory and some really abstract concept in their dreams

Step 4 – Experiment

a. What new media and technology can help people to represent and perform their dreams in a unique virtual way?

– experiment a: using the motion capture, Maya and AR to represent and perform a virtual role in a dream.








b. How do human dreams relate to phenomenology and neurophysiology?

c.What kind of experiences and feedback do people want in their dreams?

Step 5 – Dialogic Journal


Pre-Thesis Week 3

Step 1. Come up with an Area and Topic

  1. Area: Performance  –  Topic: How to use performance to express storyline in a new way?
  2. Area: Dreams  –  Topic: What do people actually know about their dreams and how do thy link dreams to the real life?
  3. Area: Communication  –  Topic: How to breakthrough the barrier of limitation of languages to express and exchange ideas in order to improve social communication?

A. Brainstorm

WechatIMG1B. Freewrite



C. Mind map


Step 2. Use each of the three Methods below to ask questions

A. Brainstorming


B. Question – Response – Question


C. Wheel and Spoke


Step 3. Come up with a list of questions

  • Factual (who, what where, how, when)

– What’s the purpose to express the dream and create a dream world and dream communication?

– What makes people get interested in understanding their dream experience?

– What element may affect human’s dream experience?

– What’s the core part for a successful immersive performance experience?

– Who you want to communicate with?

  • Technical (how)

– How can people organise the dream fragments and express the dream experience?

-How do dream experience, real life memory, and psychology influence with each other?

– How to realise the communication in other one’s dream world or our won dream world?

-How technology or media can help to create the the dream world and express the dream experience?

  • Conceptual/Theoretical (What if? How might we? Is this feasible? More abstract ideas)

– What if everyone create a virtual dream world, and others can come into their dream and leave messages?

– What if the dream can be controlled?

-What if the dream world become another space or society you gonna live when you are sleeping?

Step 4. Find an accountability partner in pre-thesis

Qiushi Lin


Step 5: Visual Representation of your Area or Topic


Pre-thesis- Week2

I used the Zotero as the tool for my personal library.

This my own library for Journal Articles, Review articles, and Dissertations:lib1



Dialog Journal


Global – Online Retail.

-What does this do for me?

This article provide specific analysis and data information in global online retail system, including market value, market segmentation, and business forecasts. I can use these information to compare the online consumption model and traditional consumption model.

-What is interesting about this article?

It provide very detailed data base for recent years online retail value, and category each online industry and development trade in the future.

-What questions is this making me ask?

The article is analyzing the online consumption in a macro level and possitive way, what is the drawbacks? lost? and what can be improved?


‘Imagining’ mixed reality (MR) immersive experiences in
the post digital revolution: innovation, collectivist,
participation and ethics in staging experiments as

-What does this do for me?

The discusses and evaluates the role of artists in imagining new resources and ways of working to immerse audiences in the post-digital era. It used different methodology to provide the point that we can use immerse audience experience  beyond the VR aspect. It provide me different thinking methodologies when I want to design sth.

-What is interesting about this article?

The interesting thing is this article discusses how acting as a laboratory becomes a method of inquiry. And the ethics of testing immersive techniques and experiences in the context of live performance. It’s culturally and specially provide a thinking of interactive space and environment.

-What questions is this making me ask?

Is there an possible that when immerse audiences get out of one certain technology box and jump into another interesting one?


Virtual Performance Spaces and Digital Identity

-What does this do for me?

This paper provide a background that we are now entering in a new virtual spaces of performance, giving the illusion that virtual performance is unlimited, and then in the base, the author provide the deep thinking of the identity users may face to in this world.

-What is interesting about this article?

I like the idea of that “we experience ways of performing that step outside the boundaries of the physical world.”

-What questions is this making me ask?

In this virtual world, what is the real? what is the fake? are we gonna lost ourselves in the world?


Surrogate Stages: Theater, Performance and
the Challenge of New Media

-What does this do for me?

This article provide me a historical view and forward view of the performance and theater.

-What is interesting about this article?

It provide a lot details and plot in some performance, which I never notice before.

-What questions is this making me ask?

The paper mentioned ‘theatrical equivalent’ concept, which means that in this
production the director takes full advantage of thereat hypermedial potential. In the new media background will the theatrical equivalent be changed and how?


Wearing Down HIPAA: How Wearable Technologies Erode
Privacy Protectio

-What does this do for me?

This paper talks about HIPAA system and the health information of citizens, which can provide a specific topic guide for think about the medical wearable products.

-What is interesting about this article?

This article use a negative aspect to see the wearable and medical devices, which provide me a thinking that what can be improved next.

-What questions is this making me ask?

The article provides a lot of information about wearable may negatively impact the heath, but how about when we think of  HIPAA’s Effectiveness in a positive way?

Pre Thesis- Week 1

Step 1 and Step 2: Card Sorting


This Week I explored different topics that I am interested in, including Education, Consumption Model, Living Space, Interactive Space, Architecture, Social Media, Delivery, Art, and So on.

Step 3: 5 Topics and More Questions

1. Consumption

How to combine the online consumption model and the traditional retail model?

– What is the history of humans consumption?

– How people change their shopping methods in recent years?

– What is the benefit of online shopping, and what are its drawbacks?

– How to improving a better consumption environment for customers in the future?

-What is the most fast-growing online industry?

2. Medical Treatment

How does the development of advanced science and technology affect modern medical treatment?

-How does the development of medical equipment in recent years?

-What can help the disabled get reborn?

-What are the categories of new medical ideas?

-What are the ways to train doctors and nurses now?

-How to promote the treatment of psychological diseases?

3. Microsoft Hololens

What is the great point of Microsoft Hololens, and how does it changes people’s life?

– What is the core concept, Structure and Composition of  Microsoft Hololens?

– Who is the user base of Microsoft Hololens?

– What benefit it can bring for people by using it?

-Compared with other similar products, what are the advantages of Microsoft Hololens?

-If all of people in the world wear the Microsoft Hololens, What will the world be like? Is there any drawbacks of it?

4. Interactive Space

How to create a better interactive space for promoting social communication?

– Archeology of social communication?

– What are the important points to affect a better face to face social connection?

– What is a successful interactive space in people’s eyes?

– How to eliminate social barriers of people with social phobia by properly designing space?

-How to reorganize information through interactive space?

5. Art and Performance

In the future, how will art emerge and influence human beings?

-How do some new museums display works of art?

-What categories of art have changed dramatically because of the new media in the last decade?

-When new media art is combined with traditional art, what is the audience’s reaction?

-What new forces have the new media brought to the performance?

-Through what kind of way can bring a closer relationship of the audience and the artwork, and help the audience to understand the art better?

Step 4 &5: Key Words and Initial Research Investigation

1. Consumption

Online shopping/retail model/ new shopping model/ fashion/ fast-growing online industry

2. Medical Treatment

Disability/ Medical training/ new medical equipment/ psychological diseases

3. Microsoft Hololens

Microsoft Hololens/Modeling/ Structure and Composition/advantages/ user experiences

4. Interactive Space

information/space/ Interaction/ social barriers/successful interactive space/social communication/public space;sequence=2

Click to access cs_20170404_innovation_spaces_pdf.pdf

5. Art and Performance

Art Museum/ new forces/categories of art/new media/ Combination



Producing Test

World Rule:

In 2038, people will live in a future network  called “Soar”. Soar Company mainly produce a social media tool Helmet, which can help customers to see and feel both virtual world and reality. In this world, almost everyone use soar to connect with each other and use soar to do some documentation in daily life, such as taking photo, video, texting, gaming, sharing and so on. Everybody ware Soar everyday and wander through the semi virtual semi real world. In some particular place, you have to show your reality identity to keep the safety.


  1. Infrared sensor helps to get the person selected in your world system
  2. Delete somebody that you do not want to add in your view
  3. Block somebody in your world system
  4. Get noticed when you are blocked when you contacted to that person
  5. Pretending any virtual character Roles
  6. Take the photo, take the video,phone call, text, social sharing
  7. Set the view angle and view distance
  8. Talk to the system
  9. Read the gesture


1. How brain connect with these sensory

-Olfaction -Visual Sense – Auditory Sense -Speak Sense

2. How to block somebody on the screen and phone

Input and Output showed in the 3D prototype:

The flow chat of Soar’s operating principle

1. Input: Infrared sensor information;   Output: delete it

2. Input : your voice;   Output: talked back

3. Input: the view;   Output: make the view distance or closer


  • Camera
  • Speaker
  • Screen
  • Headphone
  • Infrared sensor

11 Arduino Exploration

Last week, we have some chance to get intouch with the Arduino in our creative coding class, and I would like to explore more and may use this technology for my final.

Arduino is an open-source hardware and software company, project and user community that designs and manufactures single-board microcontrollers and microcontroller kits for building digital devices and interactive objects that can sense and control objects in the physical and digital world. Arduino board designs use a variety of microprocessors and controllers. The boards are equipped with sets of digital and analog input/output  pins that may be interfaced to various expansion boards or breadboards and other circuits.

I am really interested in the pressure sensor, and when the pressure sensor related to  audio and pattern, there will be a lot of interesting result. I searched a lot of creative projects and got some inspirations.

Interactive LED Floor

In this project, players walk on a pressure sensitive floor, and there will be LED patterns to follow along with the movement of the player. In this project, it uses a sensing floor, which is a floor with embedded sensors. Such floors are usually used as a source of sensing information for an ambient intelligence. I like this project because it visualizes the pressure and makes the invisible things become variegated and beautiful.

Optical Pressure Sensing for Tangible User Interfaces

This video also shows an interactive design related to a pressure sensor.  A pressure sensor usually acts as a transducer; it generates a signal as a function of the pressure imposed. In this video, when the user increases the pressure, the pattern will be changed.

Various Patterns

Particle Triangles

Moving through Space

Pierre Marzin

11 Game Innovation- TumbleSeed

This week I explored some interesting game design and trying to get some innovation from these designs. Actually, there are a lot of interesting new games on the market these years. TumbleSeed is an indie action video game, created by developer Benedict Fritz and designer Greg Wohlwend, which released in 2017.

In the game, the player needs to balance a rolling seed on an ascending, horizontally slanted vine past procedurally generated obstacles to reach the top of a mountain.

The game is actually based on the mechanical arcade game Ice Cold Beer and built partially through the Cards Against Humanity game incubation program. That reminds me of a principle in the creative thinking process – Everything is remixed. Fritz get the inspiration of the old game Ice Cold Beer, and he keeps on developing the original game and prototype a new game based on the basic mechanical principle in the original game.

Fritz and his partner work together on the project by adding enemies, an in-game world, and procedurally generated levels. Their prototypes included dungeon crawl and open world, action-adventure genre explorations. They spent two years in designing the game, and finally overcome a lot of failures to get the success.

Many critics and players appreciated the haptic sense of the rolling seed from the Nintendo Switch’s sensitive HD Rumble in the game. A lot of reviewers noted TumbleSeed‘s intense and sometimes uneven difficulty, which the developers hoped to address in a post-release update. They credited this stigma and a tepid critical reception for the game’s slow sales but were proud of their work.

Written Response to “Ira Glass on Storytelling 3 & 4

In 3 & 4 videos Glass mainly talked about the expectation, working process and work result in the design process. He mentioned that there sometimes will be a big difference between the high expectation the designer set at the beginning and the work he or she is currently producing. The important thing to keep in mind is not being afraid to spend time on the process, and not being afraid of failure. Glass talked about that many people give up their idea during the process of failure when they cannot produce the work because they think these works do not match their expectation. However, if designers can keep on practicing and put their passion in the creative thinking process, they can get a really good result.

I agree with Glass. As a designer, it always happens in my creative process.  When I start a project, I will do a lot of researches and saw a lot of cool works done by other designers. However, in the process, because of different reasons, such as lacking some type of technology skills, I cannot get my high expectations. At that time, I feel really frustrating. Sometimes when I overcome this sense of loss, and keep on trying and researching, I can get a good outcome, maybe still not matches the high expectation set at the beginning, but can satisfy me.

Glass also mentioned about the critical role of interaction in a successful design or creative process. I went to a lot of interactive design exhibition, and I found all of them were interesting because I can have a feeling of getting in touch with the artwork. It is really important to build up a connection between the audience and the artwork.