CocoIndex coming to East Bay Rust 🦀 Meetup! All about Rust with friends at Zed Industries, Convex and all. CocoIndex CTO George He sharing the fun stuff about building Rust data engine. The usual pattern for this kind of library — NumPy, PyTorch, Polars — puts the heavy compute on the native side and lets Python orchestrate. We built CocoIndex the other way around. User compute runs in Python (embeddings, LLM calls, parsing). The Rust core handles the less glamorous parts: change detection, scheduling, persistence, state. Most of the interesting engineering lives at the seam between the two. A few of the things we covered: • Bridging async across two event loops (Tokio and asyncio), and the one rule that makes both directions tractable • GIL discipline beyond the obvious — what the compiler catches, and what it doesn't • A fatal shutdown-time abort and what actually caused it • One generic Rust primitive that ended up powering two completely unrelated problems — batching db writes and GPU/embedding calls from user code Thanks to Esther Trapadoux Zed Industries for having us! More on CocoIndex: https://lnkd.in/ezksH98y #Rust #Python #OpenSource
