Md. Shamim Hassan

New talent

@shamim_hassan_05

Senior Data Engineer — ELT, Dimensional Modeling & Cloud Data Platforms

New talentFrom $9/hrDhaka, BangladeshHires and manages projectsProvides services0 views

Message

Track record

Projects done

New

Talent rating

Open

Availability

About

Senior Data Engineer with 10+ years across software and data engineering, specializing in enterprise-scale ELT pipelines, Airflow orchestration, and dimensional data models. Deep expertise in advanced SQL and query optimization, Python, and layered dbt transformation architectures (staging → intermediate → mart) delivered on Snowflake. Track record processing multi-terabyte regulated datasets daily, cutting pipeline runtimes by 50% and query response times from minutes to seconds. Experienced across Snowflake, Azure, and modern lakehouse platforms, with CDC-based ingestion and SCD2 history modeling.

Experience

Data Engineer

Insightin Technology · Bangladesh

2022-01 – 2026-07

● Architected and delivered enterprise-scale ELT pipelines processing 10M+ daily records of regulated US healthcare data, with end-to-end validation and HIPAA-compliant handling. ● Designed layered transformation architectures (staging → curated → mart) and dimensional models supporting analytics and executive reporting across multiple business domains. ● Optimized SQL workloads through indexing, partitioning, and pre-aggregation strategies, reducing API response times from 5 minutes to under 2 seconds. ● Improved pipeline throughput by 50% via PySpark tuning, partition strategy, and elimination of redundant transformation stages. ● Built multi-channel campaign analytics (SMS, Email, Direct Mail), increasing member engagement by 40%. ● Established data contracts and led requirement workshops with Product Owners, Analytics, and Data Science teams, translating business needs into production-ready models and pipelines. ● Led a 15-person team spanning backend, data engineering, and data science — setting technical direction, running code reviews, and embedding data quality standards across pipeline delivery.

Sr. Software Engineer

Insightin Technology · Bangladesh

2017-10 – 2021-12

● Automated encryption synchronization across large member datasets, cutting processing time from 20 hours to 1 hour. ● Built a scalable member dashboard with search across 20+ attributes, performant over 5M+ member records. ● Delivered a high-throughput data export solution using C#, JavaScript, and Web Jobs. ● Developed an interactive survey workflow (AngularJS, MongoDB, ASP.NET MVC) that drove a 30% revenue increase.

Md. Shamim Hassan

Discuss your project

Message

Portfolio

restaurant-analytics — Snowflake CDC Analytics Warehouse

gitlab.com/shassan.de-group/restaurant-analytics 31-model dbt project transforming Postgres CDC events into an analytics-ready Snowflake warehouse for a multi-tenant restaurant SaaS (~50 restaurant groups, ~440 locations). ● Designed a three-layer architecture on Snowflake — bronze views over Airbyte-landed raw, silver current-state collapse, gold star schema — with 7 dimensions, 3 incremental fact tables, and a generated date dimension. ● Collapsed append-only CDC streams to current state using LSN-ordered dedupe windows rather than updated_at, which is non-monotonic under concurrent writers; implemented soft-delete propagation and cross-batch tenant lookup to preserve the tenant invariant through DELETE-only batches under REPLICA IDENTITY DEFAULT. ● Built incremental materializations on LSN watermarks so reruns process only new change events, with no-op runs merging zero rows. ● Authored reusable dbt macros: a parameterised business-date function converting UTC timestamps to local trading days with per-location cutoff handling across US and Canadian timezones, and a schema-name override giving uniform layer-first schemas across dev and prod targets. ● Enforced multi-tenant isolation through every layer via composite tenant-safe joins and FK relationship tests. ● Covered the project with ~200 dbt tests — primary keys, cross-layer foreign keys, accepted-values enums, tenant relationships — executing in under 15 seconds. ● Applied Snowflake clustering keys on tenant_id across large fact and dimension models to drive micro-partition pruning on tenant-scoped queries, the dominant access pattern in a multi-tenant workload. ● Configured Snowflake role-based access (TRANSFORMER_ROLE), separate raw/dev/prod databases, a dedicated transform warehouse, and key-pair authentication. Stack: Snowflake, dbt, Airbyte, PostgreSQL, Python, SQL

cms-medicare-sync — Layered ELT Pipeline

GitLab: hassan.de/cms-medicare-sync End-to-end Medicare analytics pipeline demonstrating modern ELT practice. ● Built a layered dbt transformation architecture (bronze/staging → silver/intermediate → gold/mart) with model tests, documentation, and incremental materializations. ● Implemented CDC ingestion from Postgres via Airbyte, with logical replication and SCD2 history tracking on dimension tables. ● Modeled gold-layer marts as star schemas for downstream analytics consumption. ● Version-controlled in Git with a branching workflow and structured project layout. Stack: Python, dbt, Databricks/Delta Lake, Airbyte, Neon Postgres

Md. Shamim Hassan

About

Experience

Education

Portfolio