FabNavi is a support system to capture assembling processes with videos/pictures and replaying data on (remote) tabletop. The system records works on tabletop with an overhead camera, and presents full scale videos/pictures on the tabletop (Figure 1).

Figure 1. The FabNavi system

The FabNavi system proposes visual instruction to assemble physical objects in remote places: (1) Recording the assembly processes easily, (2) Sharing these instruction on the web, (3) Replaying them on the (remote) tabletop (Figure 2).

Figure 2. Basic Concept of the FabNavi system

The system also aims to collect data of FAB processes in the real world, understand them using recognition techniques, and generate “recipes” (semi-) automatically (Figure 3).

Figure 3. Understanding FAB processes for generating recipes.


The FabNavi system mainly consists of  (1) API server, (2) Capture client, (3) Browser Client.

  • API Server
    • Running on Amazon EC2 & S3. Ready for Big data.
  • Capture Client
    • iPhone & Android Client.
  • Browser Client
    • Electron App both for Win/Mac.

Applications will be delivered on http://fabnavi.org/

Screen capture of fabnavi web app

 Project Members


  • Koji Tsukada, Keita Watanabe, Daisuke Akatsuka, and Maho Oki, FabNavi: Support system to assemblephysical objects using visual instructions, Paper presented at Fab10, Barcelona, 2-8 July (2014) [PDF]