Gopi Kunchala
I am an enthusiastic data engineer who builds and supports data pipelines on Azure using ADF, Databricks, SQL, and Python. I enjoy fixing pipeline issues, improving performance, and making data delivery smooth and reliable while continuously learning new methodologies to solve modern data engineering challenges.
About
Data Engineer with proven expertise in cloud data solutions
Data Engineer with 2.5+ years of experience designing, developing, and optimizing cloud-based data solutions. Skilled in Azure Data Factory, Databricks (PySpark, SQL), and Snowflake, with expertise in data pipeline automation using Python and PowerShell.
Proven track record in improving performance, streamlining workflows, and collaborating with cross-functional teams to deliver scalable and reliable data platforms.
Skills
Technologies and expertise driving data solutions
Pipeline Workflow
A clean ADF-style incident-to-deploy flow
Career Journey
Professional experience and academic background
Data Engineer
Day-to-Day Data Operations
- Utilized Log Analytics, Control-M, and ServiceNow for active SLA history monitoring and issue resolution
- Optimized SQL queries to improve performance and reduce execution time across data pipelines
- Developed PySpark and SQL notebooks to implement smooth data transformations for Snowflake and Delta tables loading
- Led cross-team platform initiatives to implement cloud-based Control-M level automation and job scheduling
- Implemented code fixes in shell scripts to resolve automation issues and improve reliability
- Developed large file handling solutions in ADLS Gen2 for efficient renaming and data management
- Introduced pandas-based workflows to generate automated solutions for regular data tasks
- Analyzed critical production issues and resolved them within quicker SLA timeframes
- Handled critical production challenges and performed deep analysis to maintain data load stability
- Monitored and maintained data pipeline health to ensure consistent performance and reliability
Certifications
Certifications completed
I'm passionate about data engineering with AI integration applying artificial intelligence to modern data engineering solutions to solve real-world business problems. I want to be part of building intelligent data pipelines that leverage machine learning for automation, predictive analytics, and smart data processing. My focus is on creating scalable data systems that combine traditional engineering with AI capabilities to deliver actionable insights and drive business innovation.
Get in touch
Let's connect for data engineering opportunities
