Case Studies

Organizations around the globe rely on Apache Pulsar to manage their most demanding real-time requirements.

Appen China

When serving a large volume of data collection and annotation, we faced some challenges on task distribution, anti-scamming and AI model training. We adopted the Apache Pulsar and NoSQL database solution to resolve those pain points and keep the flexibility.

Belvedere Trading

Leveraging Pulsar to stream exchange market data to the cloud.

Bestpay / Orange Financial

Together with a unified computing engine like Spark, Apache Pulsar is able to boost the efficiency of our risk-control decision deployment. Thus, we are able to provide merchants and consumers with safe, convenient, and efficient services.

BIGO

The messaging team at BIGO found themselves overwhelmed by the massive amounts of data when using Kafka. They then started to learn Apache Pulsar and ran some tests with it, after which they believed Pulsar could be a solution to their challenges. They use Pulsar as a key component in their real-time messaging architecture, which has helped them reduce the hardware cost by 50%.

China Mobile

China Mobile's practice and experience in Pulsar will be shared, such as Pulsar's Kubernetes cluster optimization and tenant function improvement.

Clever Cloud

We're using Apache Pulsar as the foundation for our cloud backbone and developed KoP (Kafka on Pulsar).

Cogito Corp

Cogito uses Pulsar for streaming real time audio and analytic results and utilizes the vital deduplication feature

Dada Group

Apache Pulsar has attracted our attention with its excellent features and great architecture.

Edge by Ascential / One Click Retail

Because of Pulsar’s unique combination of messaging and stream processing, we’ve been able to replace multiple systems with one solution that works seamlessly in our Kubernetes environment.

EMQ

ActorCloud uses Apache Pulsar to store and process streaming data, leverages Apache Pulsar Functions to handle data faster and analyzes IoT data through the SQL engine exposed to the upper layer.

Flipkart

At Flipkart, there are multiple use-cases for high throughput messaging like streaming/batch pipelines, ordered processing, auditing, etc. Pulsar offers different kinds of isolation mechanisms: cluster peering, isolation groups, produce/dispatch quotas, etc. We identified that offering topic-as-a-service can take away operational complexity for these teams and help us enforce stricter SLAs around uptime and geo-replication. Therefore we approached building a scalable and multi-tenant platform with Pulsar as the choice of backend.

GeTui

We adopted Pulsar for the new priority-based push notification solution.

Huawei Cloud

Huawei Cloud IoT requires a reliable messaging platform. After comparing the capabilities and features of multiple messaging systems, the design of Apache Pulsar is what made it our choice.

Instructure

We researched, advocated, built, integrated, and established Apache Pulsar at Instructure in less than a year.

Intuit

We adopted Pulsar for our next generation platform and adapted it for Intuit specific requirements.

Iterable

Pulsar provided the right balance of scalability, reliability, and features to replace RabbitMQ at Iterable and, ultimately, to replace other messaging systems like Kafka and Amazon SQS.

Keytop

Keytop redesigned its messaging system by using Apache Pulsar as the backbone of its architecture. Its geo-replication feature helps Keytop securely store mission-critical data across multiple data centers.

Ksyun

Currently, our service supports log query and monitoring for many businesses, and processes tens of terabytes of data every day. With Pulsar, we can scale up partitions and merge partitions easily, and process millions of topics.

Micro Focus

Modern IT and application environments are increasingly complex, transitioning to cloud, and large in scale. The managed resources, services and applications in these environments generate tremendous data that needs to be observed, consumed and analyzed in real time (or later) by management tools to create insights and to drive operational actions and decisions.

Narvar

Narvar’s platform is built with pub-sub messaging at its core, making reliability, scalability, maintainability, and flexibility business critical.

Netdata

The heart of Netdata Cloud is Pulsar. Almost every message coming from and going to the open source agents passes through Pulsar. Pulsar's infinite number of topics has given us the flexibility we needed and in some cases, every single Netdata Agent has its own unique Pulsar topic.

Newland

Apache Pulsar has multi-layer and segment-centric architecture and supports geo-replication. We can query data with PulsarSQL, and create complex processing logic without deploying other systems with Pulsar Functions.

NTT Software Innovation Center

Pulsar has a flexible design and its performance is already good enough for many use cases. The NTT Software Innovation Center ran different performance tests and implemented its own subscription model in Pulsar to further improve its performance. This has allowed them to use one Pulsar topic to support 100K consumers in their IoT scenario.

Nutanix

Apache Pulsar offers server as well as client side support for the structured streaming. We have been using Pulsar for asynchronous communication among microservices in our Nutanix Beam app for over an year in production.

Overstock

By combining Apache Pulsar Functions with Apache Ignite, we achieve low latency lookup performance for real-time enrichment of data, which is useful for search and other real-time use cases.

OVHCloud

We decided to shift and build the foundation of our 'topic-as-a-service' product called ioStream on Apache Pulsar.

Pandio

Pulsar’s flexibility makes it easy to scale and increase your capacity across hundreds of nodes as your needs change Reliable, Low-Latency: Pulsar enables you to scale to more than a million topics with little latency (< 5ms) for publishing.

ProxyClick

It gives us consistency with the messages in the queue. It also allows us to replay messages, and it’s a very powerful tool for the distributed systems that like us.

Qraft

We choose Pulsar for its ability to manage distributed transactions within a microservice architecture and its feature flexibility. Pulsar now plays an essential part in helping our AI-powered order execution system to find the optimal strategy in real time.

Sina Weibo

Sina Weibo selected Apache Pulsar and KoP (Kafka on Pulsar) due to Pulsar’s great scalability and KoP’s native support for Kafka clients. It also achieved better metadata consistency by introducing a new component Metadata Event Handler in KoP.

Softtech

Softtech built an event-based consent management system with an average throughput of 500 Million messages per day on Pulsar.

Splunk

Pulsar guarantees data consistency and durability while maintaining strict SLAs for throughput and latency. Furthermore, Apache Pulsar integrates Pulsar Functions, a lambda style framework to write serverless functions to natively process data immediately upon arrival. This serverless stream processing approach is ideal for lightweight processing tasks like filtering, data routing and transformations.

Su Ning

Building Apache Pulsar from scratch on top of the Kafka integration platform helps to achieve the goal of multi-site high availability

Tencent

After nearly 10 years of development of Tencent Game big data, the daily data transmission volume can reach 1.7 trillion. As the key component of the big data platform, the MQ system is critical to provide real-time service operational quality assurance, which requires the support of various applications such as real-time game operational service, real-time index data analysis, and real-time personalized recommendation.

THG

We quickly tested Pulsar and found it simple enough to validate some example scenarios in a day of effort

TurtleQueue

Apache Pulsar (upon which TurtleQueue is built) builds on top of the same foundation and improves on it. It exposes a cursor that advances to consume the next message. The cursor's position can be changed to something else, like the beginning of the queue.

Tuya

Tuya settled on Apache Pulsar because it proved to be the most adept at handling the accumulation of messages and repeated consumption. The addition of Pulsar has made Tuya’s message system much more efficient, resulting in lower operational and maintenance costs.

Verizon Media

Apache Pulsar provides various solutions for TLS proxy and Pulsar is the only messaging system that supports SNI proxy to leverage various enterprise proxy solutions.

vivo

After comparing different streaming and messaging tools, vivo began to learn Apache Pulsar and explored its features in scalability, fault tolerance, and load balancing. As vivo put Apache Pulsar into use, it summarized some useful practices in bundle and data management. vivo built its monitoring architecture based on Pulsar and created its customized Pulsar metrics for better observability.