DEVELOPMENT OF A SOFTWARE PLATFORM FOR CONTROLLING A WIFI-ENABLED MANIPULATOR USING A CAMERA

Authors

DOI:

https://doi.org/10.32689/maup.it.2025.1.8

Keywords:

Robotic manipulator, software platform, video stream, modularity, interaction, automation

Abstract

The purpose of this work is to create a convenient and effective program interface for controlling the manipulator, establishing communication with the camera to provide visual feedback, as well as developing a modular system that can accommodate various plugins. Methodology. The article discusses the key features of the software platform and its architecture, focusing on the interaction between the manipulator, camera, and various plugins. The manipulator, in its main function as an actuator, is equipped with clamps for work and a chamber above them (a kinematic scheme is used, a problem of reverse kinematics). The smartphone acts as a server (connected via Wi-Fi), sends commands to the manipulator. The program on the server has a modular structure: at any given time it uses only one plugin, which receives data from the manipulator through the interface, analyzes it and, depending on the functionality of the plugin, provides the appropriate commands to the manipulator. The program is developed in the Kotlin programming language using the Jetpack Compose graphics framework. It allows you to import the program to various platforms such as Linux, Mac OS, and Windows. Currently, the app only works on the Android platform. Scientific novelty. The importance of using input from a video camera in robot control, allowing tasks such as object recognition, tracking and improving decision-making, technical aspects of the application, including data exchange protocols for the manipulator and camera, plugin architecture, and user interface. Features of the modular software platform for controlling a manipulator with a video stream. Modularity, flexibility and real-time video input contribute to its practicality and relevance in the field of robotics. The practical significance of the Modular Manipulator Control Software Platform with Video Stream Implementation on Android is designed to simplify the control of robotic manipulators through a single software interface and real-time video integration to improve control and decision-making This work lies in its potential application in various industries such as manufacturing, healthcare, and automation. The modular nature of the platform simplifies integration of specific functions, making it suitable for a wide range of tasks in the field of robotics. The relevance of the platform lies in the growing demand for flexible robotic systems that can be adapted to different applications. By providing modularity and extensibility, the platform allows developers to create and integrate specific plugins for different tasks without having to reprogram the entire control system. Conclusions. The main results of the research indicate that the modular software platform successfully provides a single interface for manipulator control and real-time video stream integration. The platform’s flexibility allows users to adapt the system to different tasks, making it a valuable tool for researchers and developers in the field of robotics.

References

Golla P., Ramesh S., Bandyopadhyay S. (2023). URL: https://www.scopus.com/record/display.uri?eid=2-s2.0-85162178085&origin=resultslist

Katupitiya, Jayantha, Bentley, Kim DrivingMotors DC &Stepper. In: Interfacingwith

Lu Y., Hu B., Sun T. (2009). URL: https://www.scopus.com/inward/record.uri?eid=2-s2.0-67651153037&doi=10.1017%2fS0263574708004918&partnerID=40&md5=b6b76bdc269b31c9e03b94690f538e40

Nachtwey P. Build Better Machines Through Optimized Motion Control. SAE International, 2002. https://doi.org/10.4271/2002-01-1344

Quinn A.R.J., Saxby D.J., Yang F., de Sousa A.C.C., Pizzolato C. (2023). URL: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85151450848&doi=10.1016%2fj.jbiomech.2023.111557&partnerID=40&md5=97ebaabaec0f7bffbfb4f7f0422910c2

Sergeyeva O. V., Robuck E. A., Pavlenko N. Y., Dubovik T. N. Applications of computer systems based on the Arduino microprocessor system in chemical laboratory. The Eurasian Union of Scientists (ESU), 2019. 12 (69 (5)), 34–38.

Sergeyeva O., Lisenko V., Dubovik Т., Patalakha M. “Development of a Wi-Ficontrolled mobile video device on the Arduino NANO basis”,Eastern-European Journal of Enterprise Technologies, 2020. Vol. 3/9 (105), 55–60. DOI: https://doi.org/10.15587/1729-4061.2020.206558

Timmis H. “Mature Arduino Engineering.Making an Alarm System Using the Arduino”, Practical Arduino Engineering. Apress. 2011. 197, doi: https://doi.org/10.1007/978-1-4302-3886-7_8

Tze Fun Chan., Keli Shi. Applied Intelligent Control of Induction Motor Drives. John Wiley & Sons (Asia) Pte Ltd., 2011. https://doi.org/10.1002/9780470825587

Wen K., Harton D., Laliberte T., Gosselin C. 2019. URL: https://www.scopus.com/inward/record.uri?eid=2-s2.0-850 71484243&doi=10.1109%2fICRA.2019.8793772&partnerID=40&md5=d36896e17c6e27ad8710120530434881

Published

2025-05-28

How to Cite

ДУБОВИК, Д., ДУБОВИК, Т., & МАТУС, В. (2025). DEVELOPMENT OF A SOFTWARE PLATFORM FOR CONTROLLING A WIFI-ENABLED MANIPULATOR USING A CAMERA. Information Technology and Society, (1 (16), 65-71. https://doi.org/10.32689/maup.it.2025.1.8