NashTech Insights

Databricks

Posts by categories

Posts by tags

Comparison among Data warehouse, Data lakes and Data lakehouse

In this blog we know about Data Warehouse, Data Lakes and Data Lakehouse and Compare there pros and cons of all the Infrastructures Data Warehouse A relational database management system (RDBMS) concept called a data warehouse was created to address the needs of transaction processing systems. Any centralised data repository that may be searched for …

Comparison among Data warehouse, Data lakes and Data lakehouse Read More »

Databricks – Connecting to Databricks via FASTAPI

Key takeaways:By employing FastAPI to establish a connection with Databricks, users can effortlessly access Delta Lake tables and make them accessible through APIs. This integration facilitates real-time data consumption and interaction, empowering developers to build efficient and scalable applications that leverage the capabilities of Databricks for Big Data processing and Delta Lake. Introduction FastAPI serves …

Databricks – Connecting to Databricks via FASTAPI Read More »

An idea of Zero ETL with Open-source stacks

Key takeaways:Zero ETL is being introduced by AWS, Google, Databricks, and others as a future trend in the field of data engineering. However, current solutions are only available for projects with large budgets and rely on proprietary software. This article aims to share an idea for implementing Zero ETL using the open-source ClickHouse. I. Introduction …

An idea of Zero ETL with Open-source stacks Read More »