BitFlow Fiber-over-CoaXPress Frame Grabber Integrated with NVIDIA TensorRT in Real-time Human Pose Estimation

WOBURN, MA, JANUARY 8, 2025 — In collaboration with its parent company, Advantech, BitFlow announced today that it has successfully integrated its Claxon Fiber-over-CoaXPress (CoF) frame grabber with an Advantech AI Inference edge computer and Optronis Cyclone Fiber 5M camera in developing a real-time human pose estimation project accelerated by NVIDIA TensorRT deep learning.

One of the most advanced of its kind, the pose estimation system can provide low latency analysis of athletic movement, gaming, physical therapy, AR/VR, fall detection, and online coaching. Traditional approaches to pose estimation required multiple cameras and special suits with markers, rendering it impractical for most applications. AI-driven computer vision has elevated this field where a single camera can now capture professional-grade, real-time pose estimation. 

With a processing time of less than 2 milliseconds, the system is capable of acquiring 2560 x 1916 resolution images at 600 frames-per-second. Once output to the BitFlow Claxon CoF frame grabber, the Claxon’s Direct Memory Access transmits images directly into the Advantech computer’s GPU memory, reducing bottlenecks and freeing up the CPU to apply an NVIDIA pre-trained algorithm that searches each frame for people. If the algorithm locates a person, it calculates a crude skeleton location and overlays the displayed image with a “stick figure” representing the person’s bone structure.

The Advantech MIC-733-AO AI edge computer is embedded with an NVIDIA Jetson AGX Orin that natively supports the NVIDIA TensorRT ecosystem of APIs for deep learning inference. An optional PCIe x8 iModule is available for the MIC-733-AO to accommodate BitFlow CoaXPress and Camera Link frame grabbers. 

High throughput demands of the system required the use of the BitFlow Claxon CoF model. Designed to extend the benefits of CoaXPress over fiber optic cables, the Claxon Cof is a quad CXP-12 PCIe Gen 3 frame grabber that supports all QFSP+ compatible fiber cable assemblies. In addition to high speeds, fiber cables are immune to EMI and is capable of running lengths well over a kilometer, further than Ethernet’s 100 meter limitations.

Human pose estimation image
Real-time human pose system incorporating BitFlow CoF frame grabber, Advantech AI edge computer, and Optronis fiber camera, accelerated by NVIDIA TensorRT deep learning

BitFlow Introduces SDK for NVIDIA Jetson AGX Xavier Development Kit

Jetson with a Claxon

BitFlow has released a Linux AArch64 (64-bit ARM) SDK that enables seamless integration of BitFlow frame grabbers with the NVIDIA Jetson AGX Xavier Development Kit. 

Donal Waide, Director of Sales for BitFlow, states, “Many of our customers are already using GPU solutions such as NVIDIA for image processing so adding this option to the already large BitFlow suite of adapters was a natural progression for the company. BitFlow has been supporting Linux for several years across a variety of flavors.”

Added Waide, “BitFlow was one of the first frame grabber companies to support NVIDIA’s GPUDirect for Video technology. BitFlow and NVIDIA have worked together for a number of years already.” 

With the advent of the new machine vision standard CXP 2.0 where data rates are now up to 50 Gb/S, customers are looking to process more and more data and in shorter timeframes. For this, a GPU can typically perform these tasks much more effectively than a CPU. Even with slower data rates such as Camera Link’s (up to 850 MB/S) the ability to quickly process more complex algorithms is equally important. 

The NVIDIA Jetson AGX Xavier is the first computer designed specifically for autonomous machines. It has six Engines onboard for accelerated sensors data processing and running autonomous machines software, and offers the performance and power efficiency for fully autonomous machines.