Introducing Apache Iggy™, a persistent message streaming platform written in Rust, and Apache Sourcelume, open source instrumentation for AI training-data provenance
Wilmington, DE – August 27, 2026 – The Apache Software Foundation (ASF), the global home of open source software the world relies on, today announced that Apache Iggy and Apache Sourcelume have become Top-Level Projects (TLP).
Apache Iggy is a hyper-efficient, persistent message streaming platform written in Rust, built for predictable ultra-low latency and a minimal infrastructure footprint. Designed from the ground up around a thread-per-core, shared-nothing architecture and modern Linux io_uring, Iggy eliminates userspace locks on the hot path, GC pauses, and unnecessary thread contention. Unlike traditional streaming platforms with limited protocol support, Iggy natively supports TCP, QUIC, HTTP, and WebSockets, making real-time streaming accessible across a broad range of applications and environments. With a strong focus on developer experience — including SDKs across multiple programming languages, an extensible connector ecosystem, and Viewstamped Replication Revisited-based clustering — Iggy provides a modern streaming backbone for real-time, data-intensive, and AI workloads.
“From the beginning, we’ve had an obsession with performance, predictable tail latency, and infrastructure efficiency, treating them as first-class design principles for modern data streaming,” said Kranti Parisa, Apache Iggy PMC Chair. “Today, Iggy can process millions of messages per second and hundreds of terabytes of data per day on a single node, while maintaining single-digit millisecond tail latency. Its architecture continues to be validated through demanding real-world workloads and continuously published benchmarks. Becoming an Apache Top-Level Project gives Iggy a strong, independent, community-governed foundation for the future. It’s an especially exciting time to be building streaming infrastructure, as real-time data increasingly becomes the foundation for a new generation of applications, AI, and systems of intelligence. We’re excited to keep pushing the boundaries of what modern hardware and distributed systems can deliver. Congratulations, and thank you, to the entire Apache Iggy community.”
Apache Sourcelume is open source instrumentation for AI training-data provenance, giving dataset producers, model builders, and downstream consumers a shared, vendor-neutral way to document where training data came from and under what terms it may be used. Rather than introduce a new vocabulary, Sourcelume adds an attestation and registry layer on top of existing dataset-description standards — signing, publishing, and making the metadata those standards already produce independently checkable.
“Training data is the foundation everything else in AI is built on, and right now that foundation is largely undocumented,” said Jamie Goodyear, Apache Sourcelume PMC Chair. “A signed record isn’t an endorsement — it’s accountability. A producer can state — in a standard, cryptographically signed way — exactly what they’re asserting, and anyone downstream can verify who said it and that it hasn’t changed.”
About the Apache Incubator
Open source projects need healthy communities to thrive. The Apache Incubator is the entry path into the ASF, hosting incoming projects (called podlings) and providing them with services and mentorship to help them build resilient, durable communities and adopt The Apache Way. When a podling has demonstrated an active, diverse contributor base and a track record of independent, consensus-driven governance, it graduates from the Incubator to become a Top-Level Project.
About The Apache Software Foundation
The Apache Software Foundation (ASF) is the global home for open source software, powering some of the world’s most ubiquitous software projects, including Apache Airflow, Apache Camel, Apache Cassandra, Apache Groovy, Apache HTTP Server, and Apache Kafka. Established in 1999, the ASF is at the forefront of open source innovation, setting industry standards to advance software for the public good. Learn more at https://apache.org.
The ASF’s annual Community Over Code event is where open source technologists convene to share best practices and use cases, forge critical relationships, and learn about advancements in their field: https://communityovercode.org/.
© The Apache Software Foundation. “Apache” is a registered trademark or trademark of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.
