With Apache Spark Declarative Pipelines, engineers describe what their pipeline should do using SQL or Python, and Apache Spark handles the execution.

Automation and integration were key themes at Databricks’ annual customer conference, as it showed off new generative and agentic AI features coming to its cloud data lakehouse platform.

Data and AI platform developer Databricks has raised an eye-popping $10 billion in a new round of funding that boosts the company’s valuation to $62 billion, the company said Tuesday. Databricks ...