Amazon Redshift deep dive (Part 3): Understanding Query plansThe query plan is a fundamental tool for analyzing and tuning complex queries. If you are working in data, especially data engineering…Oct 1Oct 1
Published inTowards DevAmazon Redshift deep dive (Part 2): Query execution lifecycleIn the previous article here, we discussed how the core architecture components of Amazon Redshift work hand-in-hand to serve as a complete…Aug 30Aug 30
Amazon Redshift deep dive (Part 1): Core design considerationsIn this series of blogs, we’ll peel back the layers of Amazon Redshift architecture, revealing the sophisticated mechanisms and innovative…Aug 2Aug 2
SQL Window Functions and CTEsWindow functions are significantly different from other available SQL functions and keep a special place in a Data Engineer’s heart. It is…May 8May 8
Using OpenAI API and LangChain to assist exploratory data analysisBy now, we are sufficiently aware of the capabilities offered by Generative AI and its use cases across various industries. It is a…Jan 22Jan 22
Deep dive into table indexing in Azure Dedicated SQL Pools (Azure SQL DW)It is important to understand the concept of indexing as designing efficient indexes is paramount to achieving good database and…Dec 29, 2023Dec 29, 2023
Deep dive into design choices for table distributions in Azure Dedicated SQL Pool (SQL DW)A cloud data warehouse represents a contemporary approach to storing and overseeing extensive datasets within a public cloud environment.Dec 19, 2023Dec 19, 2023
Continuous data ingestion with Snowpipe Auto Ingest and Snowpipe REST API in Snowflake (AWS)As we learned about COPY INTO command in the previous article, there are some trade-offs that need to be balanced between using Snowpipe…Dec 16, 2023Dec 16, 2023
Data Ingestion with COPY INTO in Snowflake (Local file, AWS, Azure, GCP)Enterprises are experiencing an explosive growth in their data estates and are leveraging high performant and cost effective data solutions…Dec 9, 2023Dec 9, 2023