| |
Show HN: InstinctFlash – Run 5B world-action models in real time on Jetson Thor
InstinctFlash is a high-performance serving framework that enables real-time inference of 5B world-action robotics models on Jetson Thor and RTX GPUs, achieving up to 33.78× speedup over standard PyTorch through techniques like FP8 quantization and optimized sampling. The framework supports multiple robotics model families and provides both Python and WebSocket serving APIs through a unified Runtime interface. Recent updates include full-source release, support for RTX 5090/4090 workstations, and benchmarked results showing significant performance improvements with no observed loss in task performance on real robots.
Read Full Article →
← More Tech news