October 5, 2024

Case Study: Sales Automation Platform Optimizes Platform Performance and Scale with Entrada

Discover how Entrada helped a Sales Automation Platform company optimize data infrastructure that delivered immediate value in terms of cost savings and performance improvements, and also positioned the client for future growth, enabling the company to better leverage its data assets for innovation and competitive advantage.

sales-automation

The Challenge

A leading Sales Automation software platform was facing challenges in maximizing the performance of its existing Databricks pipelines. The client’s goal was to improve data processing efficiency and evaluate the potential for migrating its EMR streaming jobs. This is where Entrada stepped in to help optimize data infrastructure and support growth objectives.

The Solution

Entrada collaborated closely with the client to deliver a comprehensive assessment of their current data infrastructure and provide actionable recommendations for enhancing performance and return on investment (ROI). The engagement focused on the following key areas:

  • Performance Optimization of Databricks Pipelines: Entrada utilized the latest capabilities of Databricks, including Liquid Clustering, Z-Ordering, and advanced partitioning techniques, to significantly improve the performance of lakehouse pipelines. The enhancements were particularly focused on jobs responsible for managing over 300 data pipelines, ensuring a more efficient and responsive data processing environment.
  • Migration to Unity Catalog: As a value-added service, Entrada migrated the client’s data pipelines to Unity Catalog. This strategic move not only improved data governance and security, but also laid the foundation for future AI and machine learning initiatives, enhancing the client’s ability to innovate and scale.
  • Optimization for DLT Compliance: To further streamline operations, Entrada optimized pipelines to be compliant with Delta Live Tables (DLT). This adjustment reduced operational complexities and ensured a more robust and reliable data processing framework.

The Results

Through strategic collaboration with Entrada, the client successfully enhanced the performance and cost-efficiency of its data infrastructure. The optimizations not only delivered immediate value in terms of cost savings and performance improvements, but also positioned the client for future growth, enabling the company to better leverage its data assets for innovation and competitive advantage:

  • 72% Cost Savings: The largest data pipeline saw a 72% reduction in run costs, translating into significant financial savings.
  • 82% Reduction in Initial Load Time: The initial load time for data processing was reduced by more than 82%, accelerating data availability and enhancing operational efficiency.
  • 50% Reduction in Run Time: The runtime for the largest tables was cut by over 50%, leading to faster data processing and improved overall system performance.

About Entrada
Entrada is a Databricks-focused consulting and implementation partner backed by Databricks Ventures. Entrada harnesses the power of Databricks to help customers accelerate their AI + data initiatives. Our expertise in AI/ML, Databricks, and analytics is centered around industry-centric solutions. Our mission is to simplify complex data + AI challenges and support end-to-end transformations, delivering future-ready solutions fast.

Learn More

Other blog posts
Digital data house representing the Mortgage Intelligence Platform by Entrada, with Cotality, Genie, and Lakebase

Mortgage Intelligence Platform: Building a Databricks-Native Lead Engine with Cotality, Genie, and Lakebase

Mortgage lenders sit on rich data across CRM, LOS, and servicing systems, yet still struggle to identify which borrowers are about to transact. Entrada’s Mortgage Intelligence Platform addresses that gap with a Databricks-native architecture: Cotality property intelligence delivered through Delta Sharing and Unity Catalog, deterministic scoring as governed SQL primitives, Genie grounded in a curated semantic layer, and Lakebase Postgres recording every approval and audit event. The result is a governed lead generation layer that tells growth teams who to contact, why now, and with what offer – and proves it afterward.

Read more Conceptual hero image for Entrada Governance Atlas representing Databricks-native data governance with Unity Catalog, Genie, and Lakebase - a glowing shield and lock over a circuit board symbolizing protected, governed metadata.

Governance Atlas: Databricks-Native Data Governance with Unity Catalog, Genie, and Lakebase

Every serious governance project eventually reaches the same uncomfortable moment: the platform has the metadata, but the organization still does not have a product. There is a catalog. There are tags. There are comments, owners, lineage events, audit rows, dashboards, policies, and a dozen local rituals around who is allowed to change what. Yet when a steward asks, “Can I safely change this field?”, the answer still arrives as a meeting, a spreadsheet, and a prayer.

Read more Abstract financial visualization with a hand typing on a laptop keyboard, overlaid with bar charts, line graphs, and binary code in blue tones, representing data analytics and billing intelligence.

Building an AI Billing Agent on Databricks: Anomaly Detection, Genie Analytics, and Governed Write-Back at Scale

Inside the Customer Billing Accelerator from Entrada and Databricks, an agentic AI stack that detects anomalies, answers finance questions in plain English, and writes back to source systems, all governed through Unity Catalog.

Read more
Show all posts
GET IN TOUCH

Millions of users worldwide trust Entrada

For all inquiries including new business or to hear more about our services, please get in touch. We’d love to help you maximize your Databricks experience.