Amazon Redshift deep dive (Part 3): Understanding Query plansThe query plan is a fundamental tool for analyzing and tuning complex queries. If you are working in data, especially data engineering…Oct 1, 2024Oct 1, 2024
Published inTowards DevAmazon Redshift deep dive (Part 2): Query execution lifecycleIn the previous article here, we discussed how the core architecture components of Amazon Redshift work hand-in-hand to serve as a complete…Aug 30, 2024Aug 30, 2024
Amazon Redshift deep dive (Part 1): Core design considerationsIn this series of blogs, we’ll incrementally peel the layers of Amazon Redshift architecture, revealing the sophisticated mechanisms and…Aug 2, 2024Aug 2, 2024
SQL Window Functions and CTEsWindow functions are significantly different from other available SQL functions and keep a special place in a Data Engineer’s heart. It is…May 8, 2024May 8, 2024
Using OpenAI API and LangChain to assist exploratory data analysisBy now, we are sufficiently aware of the capabilities offered by Generative AI and its use cases across various industries. It is a…Jan 22, 2024Jan 22, 2024
Deep dive into table indexing in Azure Dedicated SQL Pools (Azure SQL DW)It is important to understand the concept of indexing as designing efficient indexes is paramount to achieving good database and…Dec 29, 2023Dec 29, 2023
Deep dive into design choices for table distributions in Azure Dedicated SQL Pool (SQL DW)A cloud data warehouse represents a contemporary approach to storing and overseeing extensive datasets within a public cloud environment.Dec 19, 2023Dec 19, 2023
Continuous data ingestion with Snowpipe Auto Ingest and Snowpipe REST API in Snowflake (AWS)As we learned about COPY INTO command in the previous article, there are some trade-offs that need to be balanced between using Snowpipe…Dec 16, 2023Dec 16, 2023
Data Ingestion with COPY INTO in Snowflake (Local file, AWS, Azure, GCP)Enterprises are experiencing an explosive growth in their data estates and are leveraging high performant and cost effective data solutions…Dec 9, 2023Dec 9, 2023