Thermal and Proximity Sensing in Humanoid Robot Hand
About Me
Research & Projects.
Robotic Sensor Design
Tactile Sensing Artificial Fingertip for Prosthetics and Humanoids
Developed for human hand prosthetics and humanoid robotic hands, offering high-density touch sensitivity in a compact form factor, similar in size to a typical human fingertip. This fingertip was developed during my research work in tactile sensing.
High-Density Tactile Sensing Artificial Fingertip for Humanoids and Prosthetics
This project focuses on the design and development of a high-density tactile fingertip module intended for humanoid robot and prosthetic hand applications. The module is capable of measuring pressure exerted on its surface through 22 individual pressure sensors distributed across the fingertip area. It is developed using Flexible Printed Circuit Board (Flex-PCB) technology.
In this project, an origami technique is employed to fold a flat, paper-like flexible tactile sensing module into a three-dimensional shape that mimics the form of a human fingertip. Sensor data acquisition is handled by an onboard 32-bit, low-power microcontroller, and the module communicates using the SPI protocol.
The development of this module presented a number of challenges, particularly in mechanical design and electronics. Prior to this project, I had limited experience with mechanical Computer-Aided Design (CAD). I had to learn how to design both mechanical structures and electronic schematics, as well as manage the manufacturing and integration processes.
Despite these challenges, a functional prototype of the tactile fingertip was developed. While the current version is not yet optimized for production, it is capable of capturing tactile data. Ongoing work includes further optimization of the design, data collection, and analysis.
The dimensions of the fingertip module closely match those of a typical human fingertip, enabling applications in humanoid robots and prosthetic systems.
In this project, an origami technique is employed to fold a flat, paper-like flexible tactile sensing module into a three-dimensional shape that mimics the form of a human fingertip. Sensor data acquisition is handled by an onboard 32-bit, low-power microcontroller, and the module communicates using the SPI protocol.
The development of this module presented a number of challenges, particularly in mechanical design and electronics. Prior to this project, I had limited experience with mechanical Computer-Aided Design (CAD). I had to learn how to design both mechanical structures and electronic schematics, as well as manage the manufacturing and integration processes.
Despite these challenges, a functional prototype of the tactile fingertip was developed. While the current version is not yet optimized for production, it is capable of capturing tactile data. Ongoing work includes further optimization of the design, data collection, and analysis.
The dimensions of the fingertip module closely match those of a typical human fingertip, enabling applications in humanoid robots and prosthetic systems.
CAD Model
Figure 2:
The CAD model on the left illustrates the structural design and assembly of the high-density tactile fingertip module. It was created using Siemens Solid Edge, leveraging the sheet metal environment to model the foldable geometry of the flexible PCB. The part environment was used to design and integrate additional components, including pressure sensors and the onboard microcontroller.
Board Layout
The schematics and board layout of the tactile fingertip module were designed using Autodesk Eagle EDA. It was a challenging task, as a large number of vias had to be managed within a very small area. The board layout includes approximately 218 vias on a two-layer flexible PCB, with dimensions around 32 mm × 74 mm.
Figure 3: Board layout of the tactile fingertip module.
Fully Populated Tactile Fingertip Module
The tactile fingertip module is manufactured using 2-layer flexible PCB technology with a thickness of 0.11 mm. After fabrication, surface-mount technology (SMT) is used to populate the electronic components.
Figure 4 depicts the fully populated tactile fingertip flexible PCB placed next to a 10-cent coin, highlighting the size difference and the complexity of the design.
Figure 4: Fully fabricated and populated tactile fingertip module in flat form factor.
Origami
A technique called origami, a traditional Japanese art of folding paper to form intricate shapes, is applied here to transform the flat version of the flexible tactile fingertip module into a 3D shape resembling a fingertip. Although origami is a complex art and I don't have much expertise in it, I attempted a simplified version to apply the technique as best as I could. The figure below shows the fingertip after being folded using origami techniques, including both the top (Figure 5a) and bottom (Figure 5b) views. The bottom view represents the fleshy part of the fingertip.
Figure 5: Top (a) and Bottom (b) views of the tactile fingertip module folded into a 3D humanoid fingertip-like shape using origami techniques.
Tactile Fingertip on a Human Finger
Figure 6: Shows the high-density tactile fingertip module mounted on a human finger. This demonstration is for illustrative purposes only. While the module is designed for integration into a humanoid robot hand, I did not have access to the robot hand toward the end of the project. I plan to update this demonstration with a robotic hand implementation in the near future.
Future Work
Further work on data collection, analysis, and system optimization is planned. In future updates, I aim to include additional documentation such as:
- Detailed experimental results
- Data analysis and sensor performance evaluations
This project will likely continue to evolve as time allows. At the moment, my availability is limited due to involvement in other work. While I have clear plans for improvements, progress will depend on available time."
I haven't published the data, schematics, or full documentation yet, as I believe the project isn’t complete enough to share publicly. Once it reaches a point I consider satisfactory, I will make those materials available.
I haven't published the data, schematics, or full documentation yet, as I believe the project isn’t complete enough to share publicly. Once it reaches a point I consider satisfactory, I will make those materials available.
Firmware Library
Thermal and Proximity Sensing in Humanoid Robot Hand
Firmware Library for Acquiring Thermal and Proximity Sensor Data from a Robotic Hand Designed by a London-Based Firm
Thermal and Proximity Sensing in Humanoid Robot Hand
This project involves the development of a firmware library for acquiring thermal and proximity sensor data from a humanoid robotic hand designed by a London-based firm. The sensor used is the Panasonic AMG8833 Grid-EYE thermal infrared sensor.
While the embedded firmware responsible for data acquisition is not publicly accessible, a demo graphical interface has been developed to visualize the sampled thermal and proximity data in a user-friendly graphical format. The source code for the graphical interface is available on
GitHub
.
Sensor Design
Tactile Sensing Module with a Dense Arrangement of Sensors
This tactile sensing module was developed to evaluate the application of closely arranged barometer sensors in tactile sensing.
Tactile Sensing Module with a Dense Arrangement of Sensors
This module features a high-density arrangement of 36 MEMS barometric pressure sensors in a compact 50x65 mm form factor, with potential applications in robotics and other fields. The goal is to explore the sampling frequency, potential hysteresis issues, and other influencing factors. The module utilizes 36 MEMS barometric pressure sensors. In addition to this hardware, a separate controller module (GitHub) has been developed to interface with the module and sample data.
At the moment, only part of the tactile sensing hardware is populated and tested, as I’ve been occupied with other projects. I plan to resume work and publish the complete version along with test results when I have more time.
Figure 1: Shows the partially populated tactile sensing module with MEMS barometric pressure sensors.
The schematics, evaluation results, and additional details will be shared once testing and evaluation are complete. I’m documenting the progress so far, but since this is a personal project, I need to prioritize other commitments for the time being.
Possible Applications:
Possible applications of this tactile sensing module include robotics, touchpads, gaming interfaces, and other fields that can benefit from tactile sensing.
Embedded Controller
Tactile Controller
A 32-bit embedded controller module developed to efficiently retrieve and process tactile sensor data.
Tactile Controller Module
The Tactile Controller Module is an interface board designed to read tactile sensor data from a dedicated sensor module containing 36 sensors. It is powered by the PIC32MM0256GPM036 microcontroller in a UQFN 40-pin package.
The module is built to sample and manage data from high-density tactile sensor arrays, offering flexible communication options via I²C,
hardware SPI (HW SPI), and software SPI (SW SPI) protocols.
Features
- Microcontroller: PIC32MM0256GPM036 (UQFN-40)
- Protocols Supported:
- I²C
- Hardware SPI (HW SPI)
- Software SPI (SW SPI)
- Application:
- Interfaces with high-density tactile sensor arrays
- Suitable for applications requiring customizable sampling and interfacing logic
Use Case
The controller module is primarily used to sample sensor data from a high-density tactile sensing module with 36 sensors. It communicates
with the tactile sensing module using a software SPI protocol. Designed for applications such as robotics, touch-sensitive interfaces, and
pressure-mapping systems, the tactile sensing module provides detailed tactile measurements, specifically pressure data. The controller runs
essential firmware to acquire and format the sampled data, and transmits the tactile sensor data to an external system
(such as a connected computer or robot) via a hardware SPI protocol.
Populated Module
For more details on this project, visit
https://github.com/neoviki/tactile.controller.module
https://github.com/neoviki/tactile.controller.module
Computer Vision and Robotic Navigation
Vacuum Cleaner Robot: Object Detection and Navigation
One of my projects involved a vacuum cleaner robot developed by a German consumer appliances firm, where I focused on computer vision and navigation for a differential wheel drive robot.
Vacuum Cleaner Robot: Object Detection and Navigation
One of my projects involved a vacuum cleaner robot developed by a German consumer appliances firm, where I focused on computer vision and navigation for a differential wheel drive robot. The robot was capable of autonomously navigating its environment and detecting a target object predefined for its mission. It used the ROS Navigation Stack for autonomous movement and OpenCV for object detection to accomplish its tasks.
This is a proprietary project, and I do not have permission to share the source code or other related details.
This is a proprietary project, and I do not have permission to share the source code or other related details.
AI - Computer Vision
Real-Time Traffic Monitoring Using Darknet (YOLO)
This application uses the YOLO (You Only Look Once) object detection algorithm for real-time traffic monitoring. The system processes video streams using the Darknet framework to detect various objects, such as vehicles, pedestrians, and traffic signs. The model is trained on the Microsoft COCO dataset, which includes a wide variety of annotated images for object detection tasks. With YOLO’s speed and accuracy, this traffic monitoring system is well-suited for smart city applications, traffic flow analysis, and vehicle counting. Further optimizations and techniques, such as transfer learning, can be applied to enhance performance for specific traffic scenarios.
Real-Time Traffic Monitoring Using Darknet (YOLO)
This application uses the YOLO (You Only Look Once) object detection algorithm for real-time traffic monitoring. The system processes video streams using the Darknet framework to detect various objects, such as vehicles, pedestrians, and traffic signs. The model is trained on the Microsoft COCO dataset, which includes a wide variety of annotated images for object detection tasks. With YOLO’s speed and accuracy, this traffic monitoring system is well-suited for smart city applications, traffic flow analysis, and vehicle counting. Further optimizations and techniques, such as transfer learning, can be applied to enhance performance for specific traffic scenarios.
For more details on this project, visit https://github.com/neoviki/ai.vision.realtime.traffic.monitoring
For more details on this project, visit https://github.com/neoviki/ai.vision.realtime.traffic.monitoring
AI - Computer Vision
Handwritten Digit Recognition App Using CNN
An application that recognizes handwritten digits using a Convolutional Neural Network (CNN). Trained on the MNIST dataset, the model is integrated with a user-friendly GUI built using PyTkinter.
Handwritten Digit Recognition App Using CNN
An application that recognizes handwritten digits using a Convolutional Neural Network (CNN). Trained on the MNIST dataset, the model is integrated with a user-friendly GUI built using PyTkinter.
For more details on this project, visit https://github.com/neoviki/ai.vision.handwritten.digit.recognizer.cnn.mnist
For more details on this project, visit https://github.com/neoviki/ai.vision.handwritten.digit.recognizer.cnn.mnist
Computer Networks - IoT
Client-Server Architecture for IoT Data Transmission over HTTP/HTTPS
A client-server architecture for transmitting data packets over HTTP/HTTPS, designed for IoT applications. This setup is used for homegrown plant monitoring and vehicle tracking (vehicle status updated every 10 seconds), offering a cost-effective alternative to MQTT for lightweight, low-traffic communication needs. It’s ideal for simple IoT ecosystems where frequent or intensive data exchange isn't necessary.
Client-Server Architecture for IoT Data Transmission over HTTP/HTTPS
A client-server architecture for transmitting data packets over HTTP/HTTPS, designed for IoT applications. This setup is used for homegrown plant monitoring and vehicle tracking (vehicle status updated every 10 seconds), offering a cost-effective alternative to MQTT for lightweight, low-traffic communication needs. It’s ideal for simple IoT ecosystems where frequent or intensive data exchange isn't necessary.
For more details on this project, visit https://github.com/neoviki/iot.data.exchange.over.https
For more details on this project, visit https://github.com/neoviki/iot.data.exchange.over.https
Other Projects
List of Other Projects I have Worked On
I’ve worked on a variety of projects based on my interests and the challenges I encountered along my journey. These projects span across AI, Computer Networking, Linux, GUI, Terminal tools, as well as Robotics and Electronics. I’ve documented and published them on GitHub. This section includes a list of those projects along with their corresponding GitHub URLs.
List of Projects
I've had the opportunity to work on projects across a range of fields, including telecom, vehicle telematics, IoT, computer vision, and robotic sensor design - covering areas such as computer science, electronics, and robotics. These projects were practical solutions to challenges I encountered in both day-to-day computing and industry environments. They include Linux utilities, drivers that optimize and streamline personal and industrial workflows, Artificial Intelligence driven applications and command-line tools using `awk`, `sed`, and regex for data splitting, filtering, manipulation, and interpretation. I've also developed C/Python libraries and packages, as well as custom hardware modules such as tactile sensors for robotic sensing.
Below is a list of selected projects, all of which I've published on GitHub.
| Nr | Project Details | Reference |
|---|---|---|
| 1 | ai.vision.realtime.traffic.monitoring | Link |
| 2 | flexible.tactile.sensing.module.dual.sensors | Link |
| 3 | tactile.controller.module | Link |
| 4 | ai.vision.handwritten.digit.recognizer.cnn.mnist | Link |
| 5 | ai.vision.image.classifier.cnn.cifar10 | Link |
| 6 | ai.ml.classification.knn | Link |
| 7 | ai.vision.blur.faces | Link |
| 8 | ai.vision.face.detector | Link |
| 9 | linux.embed.dir.to.bash.script | Link |
| 10 | linux.over.the.air.update.utility | Link |
| 11 | linux.remote.debugger.utility | Link |
| 12 | linux.rpi.samba.file.share | Link |
| 13 | linux.rpi.vnc.server | Link |
| 14 | linux.rpi.wifi.access.point | Link |
| 15 | linux.wifi.monitor | Link |
| 16 | graphical.interface.grid.eye.sensor.electron | Link |
| 17 | graphical.interface.gyroscope.sensor | Link |
| 18 | graphical.interface.robotic.gripper | Link |
| 19 | graphical.interface.serial.monitor | Link |
| 20 | iot.data.exchange.over.https | Link |
| 21 | eagle.library.pic32mm0256gpm036.uqfn.40pin | Link |
| 22 | eagle.library.pic32mm0256gpm028.uqfn.28pin | Link |
| 23 | arduino.AMG8833.grid.eye.sensor | Link |
| 24 | arduino.Bosch.BMP384.pressure.sensor | Link |
| 25 | arduino.VL6180X.time.of.flight.distance.sensor | Link |
| 26 | arduino.esc.controller | Link |
| 27 | audio.joiner | Link |
| 28 | audio.multiplier | Link |
| 29 | automate.ceph.distributed.storage.setup | Link |
| 30 | automate.transaction.on.ebay | Link |
| 31 | crop.image | Link |
| 32 | docker.wrapper.commands | Link |
| 33 | evalxai_studies | Link |
| 34 | explainable.ai.evalution.app | Link |
| 35 | expose.tcp.port | Link |
| 36 | gps.coordinates.renderer.osm | Link |
| 37 | ipc.filelock | Link |
| 38 | ipc.messenger | Link |
| 39 | ipc.shared.memory | Link |
| 40 | mac.osx.tabrun | Link |
| 41 | netcopy | Link |
| 42 | proxmox.automation.utilities | Link |
| 43 | rand.file.tagger | Link |
| 44 | responsive.css.layouts | Link |
| 45 | shortest.path.finder.sim | Link |
| 46 | terminate | Link |
| 47 | translate.textfile | Link |
| 48 | uscreen | Link |
| 49 | video.splitter | Link |
| 50 | website.backup.and.restore.utility | Link |
| 51 | html.ui.generator | Link |
| 52 | ui.python.tkinter.wrapper | Link |
About Me.
I am Viki (officially VN, representing the initials of my first and last name). By profession, I am a software architect specializing in embedded systems and telematics. Through my academic and research work, I acquired the essential skills to develop robotic sensors and create practical solutions involving artificial intelligence.
I have over one and half decade of experience in the software industry, including nearly a decade at a leading California-based computer networking company famously associated with the San Francisco Bridge (a hint, if you're curious about the company). Additionally, I have worked as a consulting software architect and manager for more than five years, serving clients across Europe and the UK. I have collaborated with and managed teams of engineers from diverse ethnic backgrounds, including professionals from France, Belgium, the UK, Russia, and South Asia.
As a software architect, I specialize in embedded systems and firmware development. My work involves designing firmware and embedded applications in automotive and telecommunications industry. I have designed software applications, control systems, over-the-air update systems, and daughter cards for predictive maintenance in trucks, compactors, and other vehicles, as well as for telecom systems.
In my academic and personal research, I have focused on developing embedded sensor modules, including both hardware and software, specifically in the field of robotics. One of my most significant achievements for myself is the development of a high-density tactile fingertip module for prosthetic hands and humanoid robots, which is detailed on my research and projects page.
My areas of interest include computing (informatics) and robotics, oriented towards embedded software and hardware design, as well as data analysis and interpretation using custom-designed utilities that integrate tools like awk, sed, regex, and SQL to identify patterns and structure unstructured data.
Contact Me.
You can get in touch with me at hello@viki.design