In the Flanders Make FAMAR ICON project, I developed an assembly state-tracker that uses a camera and computer vision to determine the progress of the assembly. The state-tracker can therefore automatically give instructions to the operator, based on the detected progress of the assembly. I developed the system in such a way that the instructions can be shown on different devices (screens, augmented-reality glasses, …) and that the state-tracker can use a combination of both static and mobile cameras.
The state-tracker was further developed within the DWI4Manufacturing COOCK integration project.