Hello, I'm

Jyothi Sree

Senior Data Engineer

Senior Data Engineer with 6+ years building large-scale batch and streaming pipelines across AWS, Azure, GCP, Snowflake, and Databricks.

I design reliable data platforms for regulated finance and healthcare environments, with hands-on ownership across Python, SQL, PySpark, Airflow, dbt, Terraform, CI/CD, and cloud-native analytics architecture.

6+Years Experience
11Projects Completed
2Certifications
Professional portrait of Jyothi Sree

About Me

Senior Data Engineer with 6+ years building large-scale batch and streaming pipelines across AWS, Azure, GCP, Snowflake, and Databricks, with a track record of cutting pipeline runtime and cost while improving data quality controls for regulated environments.

Skilled in data modeling, warehousing, Lakehouse architecture, CDC, orchestration, and governance, delivering analytics-ready datasets for enterprise production environments in finance and healthcare.

I partner with analytics, compliance, and platform teams to turn business requirements into trustworthy datasets for BI, reporting, and governed AI workloads.

6+

Years in Data Engineering

500K+

Streaming Events per Day

10M+

Daily Events Processed

Professional Experience

Sr. Data Engineer

American Express

June 2024 - PresentSan Francisco, CA, USA
  • Architected AWS Glue, S3, Redshift, and Airflow pipelines for curated financial datasets.
  • Automated validation workflows with Python, SQL, Lambda, and Step Functions.

Data Engineer

Cardinal Health

January 2023 - May 2024Dublin, OH, USA
  • Engineered Azure Data Factory, Databricks, ADLS Gen2, and Delta Lake pipelines for governed healthcare analytics.
  • Standardized governance controls with Azure Purview, Key Vault, and CI/CD practices.

Data Engineer

Apple

November 2021 - August 2022Hyderabad, India
  • Delivered Snowflake, Databricks, Airflow, and AWS pipelines for production reporting workflows.
  • Coordinated Kafka, Spark Streaming, REST API, and CDC integrations for near real-time availability.

Associate Data Engineer

Onward Technologies

August 2019 - October 2021Hyderabad, India
  • Orchestrated GCP pipelines with BigQuery, Dataflow, Pub/Sub, and Cloud Composer.
  • Modeled warehouse structures in BigQuery with SQL, dbt, and Cloud Storage.

Data Engineering Projects

Data Quality & Pipelines

Weather Data Pipeline with Great Expectations

Dockerized weather ingestion pipeline with Great Expectations checks before curated daily loads.

PythonDockerGreat ExpectationsETL

Cloud Data Lake

NYC Taxi Data Lake on GCP

GCP data lake project for NYC taxi analytics with infrastructure, ingestion, and warehouse-ready modeling.

GCPBigQueryTerraformPython

Streaming Data Engineering

Spark Kafka Cassandra Pipeline

Streaming data pipeline connecting Kafka, Spark, and Cassandra for event processing and analytical storage.

SparkKafkaCassandraDocker

Practice & Activity

Developer Activity

Contribution History

Generated GitHub activity visualization kept separate from the core data engineering project grid.

GitHubAutomation
View repository

Practice

LeetCode

Python practice repository for algorithms, data structures, and interview preparation.

PythonAlgorithms
View repository

Skills & Technologies

Programming Languages

PythonSQLBashPowerShell

Frameworks & Libraries

dbtSparkHiveGCP DataflowLangChain

Tools & Platforms

SnowflakeRedshiftDatabricksAWS GlueAzure Data FactoryBigQueryKafkaTerraform

Technical Skills

Data ModelingWarehousingLakehouse ArchitectureCDCOrchestrationGovernanceRAG

Education & Certifications

Master's in Computer Science

Florida Atlantic University

Graduate study focused on software systems and computer science fundamentals.

Bachelor's in Software Engineering

St. Francis College for Women

Undergraduate study in software engineering, programming, and systems design.

Certifications

AWS Certified Solutions Architect Professional

AWS - 2024

Databricks Certified Data Engineer Professional

Databricks - 2024

Let's Connect

Open to data engineering roles and collaborations across cloud data platforms, pipelines, Lakehouse architecture, and analytics engineering.

San Francisco, CA, USA
Open to opportunities