Challenge

A major cross-platform DevOps platform company had the goal to expand its platform’s capabilities by enabling customers to leverage Databricks Asset Bundles (DAB) natively. This integration was necessary to enhance the user experience and streamline the CI/CD process for customers who rely on both their platform and Databricks for development and deployment needs. Ideally, this solution would allow seamless integration of Databricks Asset Bundles into their platform, supporting a range of Git and CI/CD actions without requiring extensive custom code.

Solution

The client partnered with Entrada to assist in developing a CI/CD connector that allows the client’s customers to leverage Databricks Asset Bundles natively within their platform. The solution included:

Native Support for Core Git and Databricks Asset Bundle Actions: The newly developed connector enabled seamless integration of all core Git actions and Databricks Asset Bundle functionalities directly within the client’s platform which would provide users with a unified experience and eliminating the need for external tools or manual integration steps.

Advanced CI/CD Pipeline Capabilities: Entrada leveraged the power of Databricks Asset Bundles to develop complex CI/CD pipeline capabilities within the client’s platform. This integration allowed users to build, test, and deploy their code more efficiently, leveraging Databricks’ advanced data processing and machine learning capabilities.

Integration with Client’s LLM for Streamlined Onboarding: To ensure ease of use and a smooth onboarding experience for customers, Entrada integrated the new CI/CD connector with the client’s Large Language Model (LLM). This integration provided guided setup and usage instructions, making it easier for customers to adopt and utilize the new capabilities without extensive training or support.

    Results

    Through this partnership, the client expanded its platform’s capabilities, providing customers with seamless integration of Databricks Asset Bundles, boosting customer satisfaction, and enhancing overall platform value:

    20% Reduction in Operational Expenses: The streamlined integration and enhanced CI/CD capabilities led to a 20% reduction in operational expenses related to Databricks CI/CD pipeline development. This cost savings resulted from reduced complexity, lower maintenance requirements, and improved efficiency in pipeline management.

    15% Increase in Revenue: The additional connector capabilities enhanced the value of the client’s platform, leading to a 15% increase in revenue as customers adopted the new features to optimize their workflows.

    65% Reduction in Custom Code and Effort: By enabling native support for Databricks Asset Bundles, the solution reduced the amount of custom code and manual effort required to create DAB jobs by 65%, freeing up development resources and reducing time-to-market for new features.

    About Entrada
    Entrada is a Databricks-focused consulting and implementation partner backed by Databricks Ventures. Entrada harnesses the power of Databricks to help customers accelerate their AI + data initiatives. Our expertise in AI/ML, Databricks, and analytics is centered around industry-centric solutions. Our mission is to simplify complex data + AI challenges and support end-to-end transformations, delivering future-ready solutions fast.

    Other blog posts
    Abstract gear and network visualization representing the Databricks FinOps cost control architecture covered in the article.

    From Cost Visibility to Action: Scaling FinOps Intelligence with Databricks System Tables and Genie

    This post walks through the architecture Entrada built around that observation, the Serverless Cost Control Accelerator, and, more importantly, the design principles behind it. Regardless os whether we’re a platform engineer, SRE, or FinOps lead trying to decide where to invest, the principles matter more than the product.

    Read more
    Abstract healthcare data architecture showing a secure medical research platform for imaging, clinical notes, and lab data on Databricks

    Building Secure, AI-Ready Medical Research Platforms on Databricks

    Research organizations need faster, more reliable ways to prepare sensitive data for analysis without loosening their grip on governance and privacy. Across the medical research platforms we’ve built on Databricks, the same patterns keep proving their worth: cleaner ingestion, standardized de-identification, simpler access to research-ready datasets, and a foundation that holds up when analytics and AI ambitions grow. Here’s what we’ve learned about designing these environments well.

    Read more
    Post cover "Lakebase: The Death of the Siloed Application Database" by William Guzmán Daugherty Data Engineer at Entrada

    Lakebase: The Death of the Siloed Application Database

    Every enterprise manages two separate, expensive database systems: OLTP for real-time transactions and OLAP for analytics. The pipeline connecting them is the most fragile thing in the entire stack. Databricks’ Lakebase makes that pipeline optional, offering a strategic opportunity to collapse two stacks into one and finally deliver the near-real-time data that critical business applications need.

    Read more
    Show all posts
    GET IN TOUCH

    Millions of users worldwide trust Entrada

    For all inquiries including new business or to hear more about our services, please get in touch. We’d love to help you maximize your Databricks experience.