Databricks Inc., the primary commercial steward behind the popular open source Apache Spark data processing framework for Big Data analytics, published a new report indicating the technology is still ...

After an absence of about a year, and a stint as Research Director at the now defunct Gigaom Research, I've returned to ZDNet to cover Big Data. The year went by pretty quickly, but a number of things ...

Apache Ignite is an open source in-memory data fabric which provides a wide variety of computing solutions including an in-memory data grid, compute grid, streaming, as well as acceleration solutions ...

On and off, over the years, I have followed and written about the SQL-on-Hadoop saga. The adventure started with Apache Hive, which originally provided a SQL layer on top of MapReduce, bringing new ...

While Hadoop can store and access vast amounts of detailed data at lower costs, businesses are still encountering high-performance demands and they face a bevy of business questions. Emerging ...

It’s been about three years since Apache Spark burst onto the big data scene and became one of the hottest technologies on the planet. Judging by the numbers surrounding Spark’s adoption—including ...

In this video from the 2019 Spark+AI Summit, Piotr Balcer and Cheng Xu from Intel present: Accelerate Your Apache Spark with Intel Optane DC Persistent Memory. Cheng Xu is a senior architect of Intel ...

Will Apache Parquet be the "next big thing" in the Big Data/Hadoop ecosystem? It was only 14 months ago that the Apache Spark project was graduated to a top-level project by Hadoop steward Apache ...

The open source project .NET for Apache Spark has debuted in version 1.0, finally vaulting the C# and F# programming languages into Big Data first-class citizenship. Spearheaded by Microsoft and the ...

It's been amusing to watch the NoSQL movement transition from a “We don’t need no stinking SQL” attitude to a “Can I please have some SQL with that?” philosophy. The nonrelational databases that ...