Cloud Data Engineer · Chennai, India

Data pipelines that stay reliable in production.

I'm a Cloud Data Engineer at TCS with 2+ years of experience building Python and AWS data workflows, and I build data-platform projects on the side with Kafka, Spark and Databricks. Open to Data Engineer, Cloud Data Engineer and AWS roles.

View ProjectsDownload Resume
Portrait of Arjun P
Cloud Data Engineer · TCS

About

Curious about how systems really work.

I turn messy, distributed data workflows into systems teams can depend on.

At TCS my work covers Python-based ingestion, SharePoint-to-S3 workflows, AWS data services, partitioning, job scheduling, production troubleshooting and documentation. I like finding the root cause of a failure also making the workflow easier to operate.

I explored streaming, lakehouse patterns, data quality and orchestration.

Skills

Tools for the data lifecycle.

Languages

Python · SQL · Bash · Java · C++

AWS

S3 · Glue · Athena · Lambda · Step Functions · IAM · CloudWatch

Data engineering

ETL/ELT · ingestion · data quality · incremental processing · partitioning · pipeline troubleshooting

Big data & platforms

PySpark · Spark · Kafka · Airflow · Databricks · Delta Lake · dbt

Tools & databases

Git · GitHub · Docker · CI/CD · PostgreSQL · MongoDB

AI / ML foundation

Scikit-learn · PyTorch · TensorFlow · NLP · Computer Vision

Used professionally at TCS: Python, SQL, AWS (S3 and related services), ETL, Autosys. Spark, Kafka, Databricks, Delta Lake, dbt and Airflow are from projects and self-study. Depth varies by tool.

Projects

Built to solve real problems.

All on GitHub ↗

Flagship · Observability

PipelineSentinel

Problem: pipeline incidents are slow to diagnose and risky to fix by hand.

What it does: detects pipeline failures, schema drift, late-arriving data and volume anomalies, then produces an evidence-based diagnosis and runs safe, audited retries.

Design decisions: replayable event landing, and a retry path restricted to an allowlist with an audit trail.

  • Python
  • Kafka / Redpanda
  • Delta Lake
  • LLM tooling
View on GitHub ↗

Streaming · Lakehouse

Real-Time Data Platform

Kafka ingestion, Spark transformations, Databricks lakehouse storage and dbt modeling on NYC Taxi data.

  • Kafka
  • PySpark
  • Databricks
  • Airflow
  • dbt
Find on GitHub ↗

Healthcare · NLP

MedTech

Healthcare data management and patient–doctor interaction system with NLP symptom extraction and decentralized record storage. Academic project, not a clinically validated system.

  • React
  • NLP
  • IPFS
  • Blockchain
Find on GitHub ↗

Earlier projects: Voice-Controlled Object-Finding Robot · Vehicle Damage Estimation · The Language of YouTube

Experience & Education

Learned it. Put it to work.

Jul 2024 — Present

Cloud Data Engineer, Tata Consultancy Services

  • Develop and maintain Python-based data pipelines, including SharePoint-to-Amazon S3 ingestion workflows.
  • Work with AWS data services and ETL processes, including data organization and partitioning strategies.
  • Debug extraction scripts, investigate production issues and improve workflow reliability.
  • Support job scheduling with Autosys and maintain technical documentation in Confluence.

Project work above is separate and not part of my TCS role.

Education

B.Tech, CSE (AI & ML)

VIT Chennai

Certification · July 2025

AWS Certified Cloud Practitioner

CLF-C02

Earlier experience

ML Engineer Intern, SmartInternz

Applied ML, Python, model evaluation, Flask.

Resume

Prefer a PDF?

Download Resume (PDF)

Contact

Have a data challenge in mind?

Open to Data Engineer, Cloud Data Engineer, AWS and Data Platform roles.

heyaitzarjun@gmail.comLinkedIn ↗GitHub ↗