Tomohiro Kawatani, Koji Tsukada, and Kazutaka Kurihara. IoTeach:Learning Support System for IoT Programming by Integrating Real Devices and Sequential Contents. In Companion Proceedings of the 28th International Conference on Intelligent User Interfaces (IUI ’23 Companion). pp.16–20. 2023-03. https://doi.org/10.1145/3581754.3584121
FabLab 等のファブコミュニティにおいては,ユーザは 3D プリンタ等を用いた作品だけでなく,それを他者にシェアするための手順書の作成も期待されている.しかし,こうした手順書作成の負担は大きいため,実現されないことも多い.また,画像やテキスト中心の従来の手順書では細かい手技等は表現できないため,ユーザに一定の知識や技術を暗に要求してしまう問題もある．
本研究では,スマートウォッチとスマートフォンを組み合わせることで,机上での組み立て操作を手軽に記録/編集して,動画マニュアルの作成を支援するシステムを提案する.まず,モノづくり中の組立動作を両腕に付けたスマートウォッチと机上に固定したスマートフォンで記録し,モーションデータ/動画を Web 上に保存する.次に,モーションデータを元に特徴的な動作に対して,動画に手動/自動でタグ付けを行うことで,自動的にチャプターや字幕が作成され,動画マニュアルのドラフトとして活用できる.
Shinya Aizu and Koji Tsukada, Support System for Creating Manufacturing Manual using Smart Watches, In Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers (UbiComp ’18). pp. 323-326, Oct, 2018.[PDF]
FabNavi is a support system to capture assembling processes with videos/pictures and replaying data on (remote) tabletop. The system records works on tabletop with an overhead camera, and presents full scale videos/pictures on the tabletop (Figure 1).
Figure 1. The FabNavi system
The FabNavi system proposes visual instruction to assemble physical objects in remote places: (1) Recording the assembly processes easily, (2) Sharing these instruction on the web, (3) Replaying them on the (remote) tabletop (Figure 2).
Figure 2. Basic Concept of the FabNavi system
The system also aims to collect data of FAB processes in the real world, understand them using recognition techniques, and generate “recipes” (semi-) automatically (Figure 3).
Figure 3. Understanding FAB processes for generating recipes.
Implementation
The FabNavi system mainly consists of (1) API server, (2) Capture client, (3) Browser Client.
API Server
Running on Amazon EC2 & S3. Ready for Big data.
Capture Client
iPhone & Android Client.
Browser Client
Electron App both for Win/Mac.
Applications will be delivered on http://fabnavi.org/
Screen capture of fabnavi web app
Project Members
Core
Koji Tsukada (Associate Prof., Future Univ. Hakodate)
Koji Tsukada, Keita Watanabe, Daisuke Akatsuka, and Maho Oki, FabNavi: Support system to assemblephysical objects using visual instructions, Paper presented at Fab10, Barcelona, 2-8 July (2014) [PDF]
Kazuya Nakae and Koji Tsukada. 2018. Support System to Review Manufacturing Workshop through Multiple Videos. In Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion (IUI’18). Article 4, 2 pages, 2018.[PDF]
中江 一哉，沖 真帆，塚田 浩二，モノづくりワークショップを対象とした振り返り動画作成支援システム，インタラクション2017論文集，インタラクティブ発表（プレミアム発表），pp.499-502, 2-509-34, Mar, 2017．[PDF]
