Cloudera Introduces Cloudera DataFlow for the Public Cloud

A new data service on Cloudera Data Platform to automate and manage cloud-native data flows, increasing operational efficiency and reducing cloud costs.

Cloudera has launched Cloudera DataFlow for the Public Cloud, a cloud-native service for data flows to process hybrid streaming workloads on the Cloudera Data Platform (CDP). With Cloudera DataFlow for the Public Cloud, users can now automate complex data flow operations, boost the operational efficiency of streaming data flows with auto-scaling capabilities, and cut down on cloud costs by eliminating infrastructure sizing guesswork.



Data-in-Motion volumes are expected to grow exponentially, up to 79 ZB, across all industries, according to IDC’s Worldwide Global DataSphere IoT Device and Data Forecast, 2021–2025, and many organizations already leverage Apache NiFi to capture and process data across hybrid cloud architectures by visually designing no-code data flows. While the cloud provides an easy outlet for processing or storing massive volumes, there are multiple challenges that must be addressed. Deploying dozens of sophisticated data flows into a single cluster can lead to operational and monitoring challenges. When multiple NiFi flows compete for the same resources, it can lead to performance issues. IT administrators often choose larger infrastructure sizes out of caution, leading to underutilization and high costs. Finally, companies want a pay-as-you-go model to avoid paying for resources not in use.



“Cloudera DataFlow automates and manages cloud-native data flows on Kubernetes - and it is something only we offer,” said Dinesh Chandrasekhar, Head of Product Marketing, Data-in-Motion at Cloudera. “Now it is easy for our customers to boost the operational efficiency of their streaming workloads and save on infrastructure costs in the public cloud.”



“Companies are doing the balancing act between efficiency and performance on one side and cost control as they scale up their streaming workloads,” said Maribel Lopez, Founder & Principal Analyst at Lopez Research. “The adoption of hybrid cloud architectures only escalates that challenge. Tech leaders need intelligent tools that help them streamline the process of running and managing workloads in the cloud.”



Cloudera DataFlow for the Public Cloud is a powerful cloud-native service for NiFi on Kubernetes and includes key operational and monitoring capabilities that address these challenges easily and aren’t typically available with basic data flow services:



● Central Flow Catalog for manageability, discovery, and version control

● Central dashboard for monitoring, troubleshooting and performance tuning of data flows across multiple cloud clusters

● Simple deployment wizard and robust APIs for auto-scaling flows on Kubernetes managed by CDP

● Pre-built flows called “ReadyFlows” for some of the common streaming use cases


New research details cloud connectivity offerings and international WAN services of more than 200 service providers.
Informatica has announced new product innovations to further expand the longstanding collaboration with Microsoft which include the private preview of a SaaS version of Informatica’s Master Data Management (MDM) on Microsoft Azure. This will enable joint customers to rapidly combine and rationalise hundreds of data sources into a single version of truth for all of their critical business operations for all business areas – resulting in a repository of trusted data to generate valuable insights from. Informatica’s SaaS MDM for Azure will be available for purchase via the Azure Marketplace.
Pega Cloud to be offered on Google Cloud to give clients more cloud choice.
Informatica has launched the Intelligent Data Management Cloud (IDMC) for Financial Services, an end-to-end integrated data management cloud that enables the entire data lifecycle, including data discovery, ingestion, integration of data and applications, quality improvement, single views and business 360 applications, governance, privacy, and data sharing and democratisation.
Kyndryl and NetApp have formed a global alliance to help customers transform their businesses by unlocking insights from data stored on premises, in the cloud and edge computing environments.
The West Midlands Police are the first force to deploy Exterro's cloud-based digital forensics platform based on the FTK® Central platform housed on Microsoft Azure. This is a pioneering project that has paved the way for a national digital forensics service, enabling cases to be worked on remotely, officers to collaborate and cases to be resolved at speed.
New advancements in cloud analytics and data governance deliver on company's purpose to deliver analytics for all.
NetApp® has announced the general availability of Spot PC, the managed cloud Desktop-as-a-Service (DaaS) solution — with security, automation, observability and optimization designed for the public cloud and for the needs of today’s remote and distributed working environments.