about

Abdul is a Senior Software Engineer, with experience building bespoke analytical tools and data driven products at scale for Fortune 500 companies and fast growing start-ups. His background in research, development and project management informs his agile but playful approach. He considers himself a lifelong learner and is eager to stay in tune with the latest technology and science. Abdul believes in the power of cross pollination of domains thus his side projects range from card making to wood working.

Abdul is always interested in a new challenge. Reach out on any channel to connect!

work

Experience

SENIOR DATA ENGINEER, KOMODO HEALTH
MAR 2019 - PRESENT
  • Developed a framework and utilities in Python that led to an exponential decrease in the development time of scripts and DAGs used for ingesting and processing data.
  • Led POC of Data Engineering Platforms and migration of data pipelines across the organization to a new platform.
  • Built and optimized Spark jobs written in Scala focused on data processing.
  • Built Docker images and Kubernetes deployments to run Spark and Airflow.
  • Built a framework in Python to validate data quality at multiple stages in a data pipeline.
  • Hired Data, QA and Infra Engineers at senior and junior levels to double the number of engineers.
SENIOR DATA ENGINEER, PUBLICIS GROUPE
NOV 2017 - MAR 2019
  • Develop ETL pipelines with Scala Spark Apps (running on AWS EMR) to ingest 150GB of data delivered daily.
  • Optimize Spark parameters using Ganglia and Spark Console to reduce operating costs.
  • Monitor and troubleshoot 20+ AWS Simple WorkFlow and Data Pipeline jobs that run continuously.
  • Construct Elasticsearch clusters holding 1TB of data to meet the performance demands of the frontend product.
  • Optimize ES index loading which resulted in a decrease of 80% in time.
  • Interface with technology vendors and provide POVs on their capabilities to VP of Engineering.
  • Review pull requests from Data Engineering/Data Science and provide coding and deployment guidance.
SOFTWARE ENGINEER, SPARK FOUNDRY
SEPT 2016 - NOV 2017
  • Construct, implement, and QA SQL queries for Redshift databases to port into internal and external facing BI tools.
  • Wrangle and munge data to discover and convey learnings to client leads.
  • Develop python based ETL processes to optimize in real-time media.
  • Build OLAP data warehouse for cookie level analysis and path-to-conversion modeling.
SENIOR DATA ANALYST, MEDIAVEST
MAR 2015 - SEPT 2016
  • Drive efficiency by building automated reporting and analytic processes using Python and Amazon Redshift.
  • Develop and manage scripts in Python using Pandas load data from disparate APIs into a Hadoop based platform.
  • Provide oversight and technical support for Proctor and Gamble's business intelligence analytic platform.
RESEARCH LEAD, POLYSOPHY INC.
AUG 2013 - MAR 2015
  • Develop Excel Macro enabled templates to automate the data munging of research data.
  • Run statistical analysis on quantitative data for academic journals.

ToolKit

Python

Scala

Java

SQL

Shell

Javascript

Infustructure & Frameworks
Amazon Web Services (EKS, Kinesis, Lambda, EMR, EC2, Data Pipelines, SWF, Redshift, S3, KMS, Route53)
Snowflake, Kubernetes, Airflow, Docker, Apache Spark, Hadoop, SBT, Gradle, CircleCI, Docker, Elasticsearch, Pandas, Jupyter, Jenkins, Luigi, MongoDB, Jira, Confluence, Excel

Education

Macaulay Honors College
Bachelor of Science in Chemistry
Bachelor of Arts in Mathematics
Minors in Computer Science and Physics
Stuyvesant High School

projects

all builds crafts
Pantry Install
Sink Remodel
Shower Remodel
Closet Remodel
Small Bluetooth Speaker
Big Bluetooth Speaker
Electric Skateboard
ESkate Controller
3D Printed Lantern
Bracelet
Arc Necklace
Edible Arragement
Light -> Planter
V-Day Card
Birthday Card
V-Day Card
Moving Card