Hi, I'm

Abhilash

I build data pipelines that power insights.

View My Work Contact Me
Abhilash
01.

About Me

A passionate Data Engineer with a drive to build robust data pipelines and systems that transform raw data into actionable insights. My journey in the data world began during my university days where I developed a fascination with how data can solve complex business problems.

Currently, I'm working at Amazon, where I focus on automating ETL pipelines and optimizing data workflows to support machine learning applications. I find immense satisfaction in designing efficient data solutions that can handle vast amounts of information while maintaining high accuracy.

Here are some technologies I've been working with recently:

  • ▹ SQL
  • ▹ Python
  • ▹ Kafka & Streaming
  • ▹ AWS Cloud
  • ▹ JavaScript
  • ▹ Airflow
Abhilash - Data Engineer
02.

Where I've Worked

Catalog Associate – Data Operations

@ Amazon October 2023 - Present
  • ▹ Designed and implemented advanced ETL pipelines leveraging Python, SQL, and AWS services (S3, Athena, Glue), resulting in a 20% increase in data processing efficiency.
  • ▹ Created a comprehensive data validation framework using SQL-based scripts, improving data accuracy from 70% to 95+%.
  • ▹ Collaborated with cross-functional teams to develop and optimize data workflows for product classification.

Data Research Intern

@ Sagacito Technologies July 2023 - October 2023
  • ▹ Developed Python-based automation scripts for data collection processes, reducing manual effort by 50%.
  • ▹ Engineered complex SQL queries to analyze market trends and competitor advertising patterns.
  • ▹ Created interactive HTML-based data reports with dynamic visualizations.
03.

Featured Projects

FIFA World Cup Data Pipeline

FIFA World Cup Data Pipeline

End-to-end data engineering solution using Azure cloud infrastructure

Azure Databricks Python
Real-time Stock Market Analysis

Real-time Stock Market Analysis

Real-time data processing pipeline using Apache Kafka and AWS

Kafka AWS Python
Data Quality Framework

Dagster Cloud Project

A cloud project using Dagster and DuckDB

Python Dagster DuckDB
04.

Skills & Technologies

Databases

  • SQL (MySQL, Microsoft SQL, PostgreSQL)
  • MongoDB
  • Amazon Redshift

Cloud & Big Data

  • AWS (S3, EMR, Glue)
  • Apache Spark
  • Apache Kafka
  • Azure Data Factory

Programming

  • Python
  • SQL
  • JavaScript
  • C++

Tools & Frameworks

  • Airflow
  • Docker
  • Git
  • Tableau
  • Power BI
05.

Get In Touch

Let's Build Something Amazing Together

I'm currently open to new opportunities and my inbox is always open. Whether you have a question or just want to say hi, I'll try my best to get back to you!

Say Hello

Download Resume

Designed & Built by Abhilash