Practice to setup a Test Environment
In the software testing lifecycle, we need to set up and manage the Test Environment to support accurate and reliable […]
Data Solutions
Data Governance, Data Quality, Data Ingestion, Data processing, Data pipelines, Data Mesh, Lake, Warehouse
Harnessing the Power of Data Analytics: Unleashing Business Potential
Introduction: Businesses are constantly looking for new strategies to gain a competitive edge in today’s data-driven world. Data analytics is
The Importance of Data Visualization
Introduction: Welcome to our blog about the importance of data visualization! In today’s fast-paced, data-driven world, we are constantly bombarded
ETL TESTING – It is important for a project to collect data from multiple sources
When we build up a system which need more data such as for decision-making, market analytics, risk managements. We need
Databricks – Connecting to Databricks via FASTAPI
Key takeaways:By employing FastAPI to establish a connection with Databricks, users can effortlessly access Delta Lake tables and make them
Tale of Three Data Houses: Data WAREHOUSE, Data Lake & Data LakeHOUSE
Before diving into the technical aspect of each of the three terms, let’s take an analogy of building a library
Types of Data Professionals
Data topic is trending today, and everyone will have their view of it. So, I will write about four types
Accessing Delta lake without using spark
Key takeaways:Delta Lake, an optimized storage layer, offers advantages like ACID transactions, schema enforcement, and data versioning. Connecting to Delta
Data Mesh: Rescue to traditional data architecture challenges
Nowadays, “Data Mesh” is a buzzword in the world of Data management, especially for organizations that deal with tons of
An idea of Zero ETL with Open-source stacks
Key takeaways:Zero ETL is being introduced by AWS, Google, Databricks, and others as a future trend in the field of
Build a lakehouse solution with AWS Glue
Key TakeawaysThe data lakehouse plays a pivotal role in today’s data landscape by addressing the challenges of handling big data,
Streaming data with log-based CDC using Debezium, Kafka and KSQL
Key takeaways:These days, there is a growing demand for data streaming, particularly in distributed systems. In this article, I would