top of page
Screen Shot 2020-02-16 at 7.23.43 PM.png


Building present in the open,

one week at a time.

Progress update

Bring interfaces to
real world

Explore ways to bring on-screen experience to a shared space where
people can interact with the internet on top of physical objects.

My first focus will be on books.

Latest Updates

Week X


Thanks for checking out! Moving regular updates to subscribed friends only for now. Will post more as we make more progress. Stay tuned >:)

Historical Updates

Detect book cover

Week 11 


Hi friends! I'm finally catching up the slack! ( sentimental stuff here - was slightly lost for a while after knowing the complexity of this project + reading it's time to build. This project can be very useful if done right, else super useless)

Product side - Revisited long term vision. Instead of steer deep into one specific use case, expand interactions to accommodate more possible use cases. (more to come next week)

Hardware side - Stable, even though I am aware now that my pi + pi-camera are crap for real time processing. :( 

Software side - Done real time book framing! Turns out it's super basic. Next will be the hard part - make sure it's agnostic to various lighting situation and cover complexity. Need to re-prioritize cover vs inline annotation code next week.

Recruit - Can't do this alone! If you're interested in hacking this possible future, let me know!


Onboarding animation

Just so you know how ridiculous

the current set up is.

Product vision journal ->

Week 6


Hi friends, didn't do Pioneer update this week. Decided to move away from Pioneer to straightly focus on building instead + take care of other aspects of life, such as corona crisis world.

Software side -
Made great progress on computer vis. :) 

Screen Shot 2020-03-15 at 1.44.55 AM.png
Screen Shot 2020-03-14 at 11.13.39
Screen Shot 2020-03-14 at 10.48.40

Week 5


Hi friends, welcome to another week of update. This week, we've made big progress on building out annotation use case. Exciting things coming.

Product side - Developing annotation use case, will show more later. For brief sketch, see about. Started a team, and mood board.

Hardware side - Considering new clamp for holding the device.

Software side - Explored web client! Also, made progress on object detection. Next step is to make it real time.

Screen Shot 2020-03-09 at 1.03.38 AM.png
Screen Shot 2020-03-09 at 1.05.10 AM.png

Week 4


Hope you all have a great leap day!

I hear you on the feedback on being more clear in my progress update, so I decided to write out the details in paragraph.


Product side - answering some questions about "why do you do this project?", "what do you mean by bringing interfaces to books" at About page. TLDR: this is an exploratory project on improving my own reading experience, and if it works, maybe it could help improve others' experience too.

Hardware side - designed and 3D printed a case for the device! (HUGE thank you to Work hard, play hard@NB for helping me out) Why we need a case? Because it takes time to reposition the camera and projector - having a case will stabilizes the movement and enables me to go into software dev mode faster! This is 1st iteration. 2nd iteration is in the pipeline.

Software side - did a tutorial on simple shape recognition, and read a ton of documentation on the openCV methods. (see my learning log) Now I understood (in general sense) how shape recognition works -- next step is to apply my learning to the camera script, so the camera can recognize where the book is.

Drew out what information 

will be projected on books

Top view of the device: 

camera projector offset is important. That's why we need a case.


3D model of the case

Screen Shot 2020-03-02 at 12.18.34

3D printing


Case refinement plan


Learning shape recognition algo

Screen Shot 2020-03-02 at 12.23.22

Projector/camera stable setup

Week 3



Completed stable set up

Wrote basic camera script: read from desk

Wrote basic projector script: project frame


Got feedback on use cases - uncovered     challenge: people don't read on desk 

Started exploring input devices

Testing bounding box


Camera stream running


Projecting program from pi


Week 2



Set up clamp and mounted projector
Received camera


Created this website
Continue adding use cases for books

Booting up the pi


Setting up pi


Clamp mounted

with laser projector


Bookmark use case


Week -22


Started last summer. Toyed with 

a bunch of faulty projectors. Took me a 

while to understand what needs to be done.

(turns out it's nothing new under the sun!)


Week -510


"Sixth Sense on youtube, dope!"
- 2010 Tinnei's diary

The video:


Future updates

will be added here

Feel free to check back if you're interested in following along my progress. 

Alternatively, you can also send

me a note so I know you exist!

Thank you for stopping by! Have a great day!

bottom of page