Databricks speeds up bulk data loads in Lakebase Postgres
Databricks says its LTAP (Lake Transactional/Analytical Processing) architecture now lets customers load terabytes of data into Lakebase Postgres in minutes by offloading heavy data ingestion tasks to distributed engines like Spark. Previously, importing a billion rows took over 8 hours and saturated the database. With LTAP, the same task now takes under 5 minutes, and live application performance isn't affected.
- LTAP offloads heavy ingest to Spark cluster
- Prior bulk loads slowed live Postgres traffic
- Current loading 1TB takes under 5 minutes
- No impact to operational workloads during ingest
Sources covering this
In this story
More in Enterprise
Databricks releases Funke for HL7v2 healthcare data parsing
Databricks introduced Funke, a new tool for parsing HL7v2 messages directly within its platform.
Databricks adds zero-copy connector for Workday data
Databricks has launched a public beta for its connector letting customers access Workday HR and finance data straight from the…
SUNY unveils AI research platform with Google Cloud
SUNY and Google Cloud just rolled out an AI and high-performance computing platform for research, initially across nine top SUNY campuses.
SAP makes Joule Work and AI features widely available
SAP says its AI assistant Joule Work is now generally available, along with other major AI features.