Pulsar is a highly scalable, low latency messaging platform running on commodity hardware. It provides simple pub-sub and queue semantics over topics, lightweight compute framework, automatic cursor management for subscribers, and cross-datacenter replication. The project was originally developed at Yahoo (now part of Oath), and was submitted to the Apache Incubator June 2017.
The unique architecture of Pulsar, which separates the serving and storage layers, leveraging Apache BookKeeper as the storage component, has proven to be a key strong point. The two layers architecture enables Pulsar to offer a vastly simplified approach to the cluster operations, allowing operators to easily expand clusters and replace failed nodes, or by providing a much higher write and read availability.
Apache Pulsar is in use at MercadoLibre, Oath, One Click Retail, STICorp, TaxiStartup, Yahoo Japan Corporation, and Zhaopin.com, among others.
"Launching Pulsar at Yahoo in 2015, our goal has always been to make Pulsar widely used and well-integrated with other large-scale open source software," said Joe Francis, Director, Storage and Messaging, Oath. "We are excited for Pulsar’s graduation and to see the growth of its vibrant open-source developer community within The Apache Software Foundation. At Oath we run Apache Pulsar at scale across many major products — including Yahoo Mail, Yahoo Finance, Yahoo Sports and Oath Ad Platforms — and in multiple data centers across the globe, with full mesh replication. Pulsar will continue to be an integral part of our tech stack, in streaming and also as a bridge between public and private clouds in our hybrid cloud strategy."
"At Zhaopin.com, we have used Apache Pulsar to build our enterprise event bus, because it has many enterprise features to address the shortcomings of existing messaging systems, such as message durability, low latency," said Hui Li, Director of Infrastructure Group at Zhaopin. "We also contributed a few exciting features to Pulsar, and are planning to work with the community to contribute more. It’s been thrilling to watch the community grow, and I’m very proud and excited to see that the project is graduating. Pulsar has a bright future, and I’m looking forward to what’s to come."
"With the graduation, we hope to take the Apache Pulsar project and community to the next level and to reach a wider set of users and contributors, with the ultimate goal of building a strong ecosystem," added Merli. "We welcome anyone to join our efforts by helping with code, documentation or technical discussions in our forums."
Catch Apache Pulsar in action at ApacheCon North America 24-27 September 2018.
Apache Pulsar software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project’s day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Pulsar, visit http://pulsar.apache.org/ and https://twitter.com/apache_pulsar .
About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server –the world’s most popular Web server software. Through the ASF’s meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation’s official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Anonymous, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF
© The Apache Software Foundation. "Apache", "Pulsar", "Apache Pulsar", "BookKeeper", "Apache BookKeeper", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.
# # #