I'm a computer vision engineer focused on building and deploying AI models on real-world devices.
I mainly work with vision models on mobile and edge hardware, and I'm currently exploring larger models, including LLMs, on resource-constrained devices.
Currently building an on-device AI system with Raspberry Pi 5 + Hailo-8:
- NPU-accelerated vision inference
- A small LLM agent running on the CPU
- Quantization and inference runtime benchmarks
Tools: PyTorch · ONNX / ONNX Runtime · Hailo DFC / HailoRT · ncnn · llama.cpp · NVIDIA Triton · MLflow · Docker