Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This looks very neat. Do you think something like a Jetson Nano would be able to handle inference locally?


Thanks! The short answer is that I don't know, as it's only been run on EC2 instances, but given its current compute needs, probably not.

The longer answer is that this project has a ton of room for optimization, some of which is mentioned in the repo, and with lower latency requirements + optimizations, I don't see why it wouldn't work on less powerful hardware (I've never personally worked with the Jetson Nano, so I don't want to speak with any false confidence on it specifically).


I guess object detection is the bottleneck of the pipeline, which highly optimized YOLOv4-tiny[0]could get to 39 FPS on Jetson Nano. Also camera decoding with Nvidia Deepstream is a lot faster than OpenCV.

[0] https://github.com/pjreddie/darknet/issues/2201




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: