Aman Soni
Data + AI @ Databricks | GTM | Data Engineering | Spark, SQL, Gen AI, Azure Databricks
DatabricksAs a seasoned Data Engineer with over 5 years of experience, I excel in crafting robust data pipelines and platforms to drive analytics and data-driven insights.
More
My expertise spans across managing and processing vast datasets, optimizing system performance, and implementing cost-effective solutions. Throughout my career, I have successfully executed ETL processes handling over 200+ TB of data, significantly reducing latency, enhancing storage, and minimizing error I have engineered a robust big data framework processing, enhancing data analysis capabilities and providing analysis-ready data from 30+ sources for diverse pharmaceutical clients. My initiatives in production deployments and optimizing runtime achieved a 50% reduction, while automation of data tasks using AWS Lambda led to a 60% improvement in operational efficiency, cutting data processing time by 50 hours per Have led a team in agile-driven enterprise implementations, I have streamlined analytics and reporting processes, boosting data accessibility by 35%. My expertise in dimensional and multi-dimensional modeling, coupled with automating DQ Checks and report generation, resulted in $500K savings and reduced operational overhead by I am passionate about leveraging data to uncover insights and drive strategic decisions. I thrive in dynamic environments, constantly seeking innovative solutions to complex data challenges. Let's connect to explore how I can contribute to your organization's success with my data engineering expertise. Skills:- Programming Languages: SQL, Python, PySpark, Spark, Spark SQL- Cloud Platforms: AWS, GCP, Azure Data Lake- Scripting Languages: Bash, C++, Python, HTML- Data Warehousing: Snowflake, Amazon Redshift, Presto, Elasticsearch- ETL/ELT Tools: Microsoft Excel, Jira, Confluence, Azure Ops, Git, Gitlab, Bitbucket, Airflow- Competencies: ETL/ELT Development, CI/CD, Process Automation, Data Modeling, Business Analytics, Data Warehousing, Data Analytics, Data Reconciliation, Data Normalization/De-normalization, Data Validation, Data Management, and TestingFeel free to connect with me or message me to discuss potential opportunities or collaborations. I look forward to expanding my network and contributing to data-driven initiatives.
GTM Index
- DATABRICKSJOB
- Senior Analytics Eng - GTM1Y 7M
Senior Analytics Engineer - GTM
Databricks
- SITEMINDERJOB
- Senior Data Eng5M
Senior Data Engineer
SiteMinder
- CONCERTAIJOB
- Data Eng1Y 1M
Data Engineer
ConcertAI
- Engineered a robust big data framework to process high volumes of data weekly and monthly, significantly enhancing data analysis capabilities for diverse clients. - Directed production deployments, data loads, and testing (SIT and UAT), achieving a 50% reduction in run-time. - Built enterprise big data ingestion and processing solutions using AWS (Glue), Airflow, Azure (Databricks with ADF), and Snowflake. - Pioneered automation of data tasks with AWS Lambda, improving operational efficiency by 60% and reducing data processing time by 50 hours per week. - Enhanced data quality and SQL performance by optimizing table structure for scalability, reducing runtime by 30%, and generating compre…
- ZS ASSOCIATESJOB
- Associate Consultant - Dat…8M
Associate Consultant - Data Engineering
ZS Associates
- Architected a large-scale commercial data platform for a pharmaceutical client, managing 200+ TB of data across 50+ sources via Snowflake, boosting data accessibility by 35%. - Led a 4-member team in agile-driven enterprise implementations for Healthcare/Pharma clients, overseeing the entire project lifecycle from requirement gathering to rollouts. - Demonstrated proficiency in dimensional and multi-dimensional modeling, building logical data models. - Streamlined DQ Checks automation and report generation within data pipelines, reducing operational overhead by 70%, resulting in $500K savings. - Migrated traditional on-premises ELT pipelines to AWS cloud using technologies like EMR, RDS,…
- Business Technology Analys…2Y 2M
Business Technology Analyst - Data Engineering
ZS Associates
- Executed and orchestrated an automated ETL process/data pipeline, resulting in a 60% increase in customer retention and 75% sales growth. - Developed modules for insights and KPI calculations using AWS Services (Lambda, S3, EC2, DynamoDB, Redshift, SNS, step functions) and Python for retail Buying Engine. - Leveraged Spark applications with Amazon Kinesis to ingest patient-related data into repositories like Hive, Cassandra, and HBase. - Engineered a comprehensive DQM system and automated report framework, achieving a 20% reduction in data errors and a 90% decrease in operational costs. - Designed and implemented data analytics tools, uncovering vital insights and increasing campaign effe…
- SIEMENS HEALTHINEERSJOB
- Software Development Intern6M
Software Development Intern
Siemens Healthineers
- PERSISTENT SYSTEMSJOB
- Project Trainee1M
Project Trainee
Persistent Systems
- INDIAN INSTITUTE OF TECHNOLOGY, GUWAHATIJOB
- Research Intern2M
Research Intern
Indian Institute of Technology, Guwahati
- Conducted research on algorithms for 3D integrated circuits and Through-Silicon Vias (TSVs) assignment, contributing to advancements in the field of electrical design and packaging. - Collaborated with a team of researchers to develop a shortest path algorithm for 3D ICs, optimizing the TSV assignment process. - Analyzed and interpreted complex data sets to enhance the efficiency and performance of integrated circuits. - Led the publication of findings in the IEEE Electrical Design of Advanced Packaging and Systems (EDAPS) conference.
- Job: Databricks — Senior Analytics Engineer - GTM · 2025-03 – present · 1y 5mo
- Job: SiteMinder — Senior Data Engineer · 2024-10 – 2025-03 · 5 mo
- Job: ConcertAI — Data Engineer · 2023-09 – 2024-10 · 1y 1mo — - Engineered a robust big data framework to process high volumes of data weekly and monthly, significantly enhancing data analysis capabilities for diverse clients. - Directed production deployments, data loads, and testing (SIT and UAT), achieving a 50% reduction in run-time. - Built enterprise big data ingestion and processing solutions using AWS (Glue), Airflow, Azure (Databricks with ADF), and Snowflake. - Pioneered automation of data tasks with AWS Lambda, improving operational efficiency by 60% and reducing data processing time by 50 hours per week. - Enhanced data quality and SQL performance by optimizing table structure for scalability, reducing runtime by 30%, and generating compre…
- Job: ZS Associates — Associate Consultant - Data Engineering · 2023-01 – 2023-09 · 8 mo — - Architected a large-scale commercial data platform for a pharmaceutical client, managing 200+ TB of data across 50+ sources via Snowflake, boosting data accessibility by 35%. - Led a 4-member team in agile-driven enterprise implementations for Healthcare/Pharma clients, overseeing the entire project lifecycle from requirement gathering to rollouts. - Demonstrated proficiency in dimensional and multi-dimensional modeling, building logical data models. - Streamlined DQ Checks automation and report generation within data pipelines, reducing operational overhead by 70%, resulting in $500K savings. - Migrated traditional on-premises ELT pipelines to AWS cloud using technologies like EMR, RDS,…
- Job: ZS Associates — Business Technology Analyst - Data Engineering · 2020-10 – 2022-12 · 2y 2mo — - Executed and orchestrated an automated ETL process/data pipeline, resulting in a 60% increase in customer retention and 75% sales growth. - Developed modules for insights and KPI calculations using AWS Services (Lambda, S3, EC2, DynamoDB, Redshift, SNS, step functions) and Python for retail Buying Engine. - Leveraged Spark applications with Amazon Kinesis to ingest patient-related data into repositories like Hive, Cassandra, and HBase. - Engineered a comprehensive DQM system and automated report framework, achieving a 20% reduction in data errors and a 90% decrease in operational costs. - Designed and implemented data analytics tools, uncovering vital insights and increasing campaign effe…
- Job: Siemens Healthineers — Software Development Intern · 2019-07 – 2020-01 · 6 mo
- Job: Persistent Systems — Project Trainee · 2019-06 – 2019-07 · 1 mo
- Job: Indian Institute of Technology, Guwahati — Research Intern · 2018-05 – 2018-07 · 2 mo — - Conducted research on algorithms for 3D integrated circuits and Through-Silicon Vias (TSVs) assignment, contributing to advancements in the field of electrical design and packaging. - Collaborated with a team of researchers to develop a shortest path algorithm for 3D ICs, optimizing the TSV assignment process. - Analyzed and interpreted complex data sets to enhance the efficiency and performance of integrated circuits. - Led the publication of findings in the IEEE Electrical Design of Advanced Packaging and Systems (EDAPS) conference.
- School: Indian Institute of Information Technology Nagpur — Bachelor of Technology - BTech, Electronics and Communication Engineering
- School: Central Board of Secondary Education — Senior Secondary Certificate, Science (PCM - Physics, Chemistry and Maths)
Skills
Playbooks
All playbooks →No playbooks indexed for this profile yet.
More GTM Engineers
Browse all →- Shay SpeizmanGo To Market | Strategy | Commercial Operation | Ex-BCG
QuantHealth
ex-Zocdoc
- Aditya ChauhanGTM @ Anthropic
Anthropic
ex-Google - Shishir SatheDirector of Engineering | Go-To-Market & Finance DS at Linkedin
LinkedInex-Tata Consultancy Services
- Ankit RaoGTM Strategy & Project / Program Management Leader - SMB Ads Monetization | Author | MBA | Ex- Lazada, Google, Amazon | PMP
Grab
ex-Lazada
