PinnedChayan Shrang RajData Modeling — BasicsHave you tried this in Data Modeling?Nov 15, 2023Nov 15, 2023
Chayan Shrang RajAmazon Redshift deep dive (Part 3): Understanding Query plansThe query plan is a fundamental tool for analyzing and tuning complex queries. If you are working in data, especially data engineering…Oct 1Oct 1
Chayan Shrang RajinTowards DevAmazon Redshift deep dive (Part 2): Query execution lifecycleIn the previous article here, we discussed how the core architecture components of Amazon Redshift work hand-in-hand to serve as a complete…Aug 30Aug 30
Chayan Shrang RajAmazon Redshift deep dive (Part 1): Core design considerationsIn this series of blogs, we’ll peel back the layers of Amazon Redshift architecture, revealing the sophisticated mechanisms and innovative…Aug 2Aug 2
Chayan Shrang RajSQL Window Functions and CTEsWindow functions are significantly different from other available SQL functions and keep a special place in a Data Engineer’s heart. It is…May 8May 8
Chayan Shrang RajUsing OpenAI API and LangChain to assist exploratory data analysisBy now, we are sufficiently aware of the capabilities offered by Generative AI and its use cases across various industries. It is a…Jan 22Jan 22
Chayan Shrang RajDeep dive into table indexing in Azure Dedicated SQL Pools (Azure SQL DW)It is important to understand the concept of indexing as designing efficient indexes is paramount to achieving good database and…Dec 29, 2023Dec 29, 2023
Chayan Shrang RajDeep dive into design choices for table distributions in Azure Dedicated SQL Pool (SQL DW)A cloud data warehouse represents a contemporary approach to storing and overseeing extensive datasets within a public cloud environment.Dec 19, 2023Dec 19, 2023
Chayan Shrang RajContinuous data ingestion with Snowpipe Auto Ingest and Snowpipe REST API in Snowflake (AWS)As we learned about COPY INTO command in the previous article, there are some trade-offs that need to be balanced between using Snowpipe…Dec 16, 2023Dec 16, 2023
Chayan Shrang RajData Ingestion with COPY INTO in Snowflake (Local file, AWS, Azure, GCP)Enterprises are experiencing an explosive growth in their data estates and are leveraging high performant and cost effective data solutions…Dec 9, 2023Dec 9, 2023