Amazon Redshift deep dive (Part 3): Understanding Query plansThe query plan is a fundamental tool for analyzing and tuning complex queries. If you are working in data, especially data engineering…Oct 1, 202484Oct 1, 202484
Published inTowards DevAmazon Redshift deep dive (Part 2): Query execution lifecycleIn the previous article here, we discussed how the core architecture components of Amazon Redshift work hand-in-hand to serve as a complete…Aug 30, 202434Aug 30, 202434
Amazon Redshift deep dive (Part 1): Core design considerationsIn this series of blogs, we’ll incrementally peel the layers of Amazon Redshift architecture, revealing the sophisticated mechanisms and…Aug 2, 2024121Aug 2, 2024121
SQL Window Functions and CTEsWindow functions are significantly different from other available SQL functions and keep a special place in a Data Engineer’s heart. It is…May 8, 2024124May 8, 2024124
Using OpenAI API and LangChain to assist exploratory data analysisBy now, we are sufficiently aware of the capabilities offered by Generative AI and its use cases across various industries. It is a…Jan 22, 202460Jan 22, 202460
Deep dive into table indexing in Azure Dedicated SQL Pools (Azure SQL DW)It is important to understand the concept of indexing as designing efficient indexes is paramount to achieving good database and…Dec 29, 202369Dec 29, 202369
Deep dive into design choices for table distributions in Azure Dedicated SQL Pool (SQL DW)A cloud data warehouse represents a contemporary approach to storing and overseeing extensive datasets within a public cloud environment.Dec 19, 202390Dec 19, 202390
Continuous data ingestion with Snowpipe Auto Ingest and Snowpipe REST API in Snowflake (AWS)As we learned about COPY INTO command in the previous article, there are some trade-offs that need to be balanced between using Snowpipe…Dec 16, 202394Dec 16, 202394
Data Ingestion with COPY INTO in Snowflake (Local file, AWS, Azure, GCP)Enterprises are experiencing an explosive growth in their data estates and are leveraging high performant and cost effective data solutions…Dec 9, 2023195Dec 9, 2023195