Sravya Pilli
Professional Summary
Senior Data Engineer with 5+ years of experience designing, building, and optimizing scalable data pipelines and cloud data platforms. Proven track record with AWS and Azure ecosystems, Snowflake and Redshift data warehouses, Databricks and Spark-based ETL, and metadata-driven ingestion frameworks. Skilled at improving data quality, performance tuning, and delivering analytics-ready lakehouse architectures to support risk, fraud, and executive reporting.
Technical Skills
Work Experience
- Designed and implemented Medallion Architecture (Bronze/Silver/Gold) using AWS Glue and S3, standardizing ingestion and transformations and reducing end-to-end onboarding time by ~30%.
- Built a metadata-driven ingestion framework with Snowflake and S3 using a centralized configuration catalog to parameterize pipelines and support ingestion from dozens of source systems, improving developer reuse.
- Developed scalable ETL/ELT pipelines using AWS Glue and PySpark to process large Parquet transaction datasets, improving downstream reporting throughput and processing speed by ~30%.
- Performed PySpark data quality analysis on Databricks to identify and remediate issues, increasing customer account data accuracy by 30% and supporting regulatory reporting requirements.
- Optimized Snowflake table design with partitioning and clustering strategies for historical ledger data, improving query performance by ~50% and lowering compute cost for analytics workloads.
- Implemented monitoring and automated alerting for overnight ETL using AWS Lambda and Python, reducing troubleshooting time by 30% and decreasing recurring pipeline errors by 25%.
- Architected a Medallion Architecture on OneLake with Databricks Spark and Snowflake to handle enterprise data streams, reducing data latency by 30% and enabling predictable downstream analytics.
- Designed and maintained ingestion pipelines using Microsoft Fabric and Azure Data Factory to ingest high-volume payloads from REST APIs and SFTP, increasing ingestion speed by 30%.
- Embedded automated data validation and profiling in Fabric-compatible PySpark notebooks to detect structural anomalies and schema drift before downstream consumption.
- Led migration of legacy on-prem ingestion workflows into a Delta Lake environment within Fabric, modernizing pipelines and reducing end-to-end latency by 30%.
- Engineered Power BI semantic models with advanced DAX and explicit relationships to produce low-latency executive dashboards using Fabric Direct Lake patterns.
- Implemented CI/CD for notebooks and pipelines with Azure DevOps and automated orchestration using Azure Logic Apps, cutting deployment time by 40% and scheduling errors by 50%.
- Spearheaded migration of legacy data systems to Azure Cloud, cutting infrastructure operational costs by 25% while improving query processing scalability for client analytics.
- Engineered and optimized high-performance SQL scripts and stored procedures to ETL data from disparate relational sources, improving extraction throughput and reliability.
- Used Python and Pandas for high-speed data manipulation to prepare analytical datasets and accelerate downstream reporting and model training preparation.
- Troubleshot production data load failures and optimized SQL Server joins, subqueries, and schemas to stabilize production ETL and reduce recurring failures.
- Built stakeholder-facing dashboards and visualizations using JavaScript and modern web frameworks to translate warehouse metrics into actionable insights.
- Drove Agile delivery practices including daily Scrum, sprint planning, and retrospectives to align cross-functional teams and maintain sprint commitments.
- Developed Power BI dashboards and DAX calculations to surface participation metrics, driving an 18% uplift in user engagement identified through analysis.
- Performed data cleaning and exploratory data analysis using Excel and Google Sheets to prepare reliable datasets for reporting and stakeholder review.
- Built an interactive Google Data Studio dashboard to visualize key metrics for management and streamline monthly reporting cycles.
- Adopted PySpark to implement DataFrame transformations and established ADLS Gen2 storage standards to improve large dataset processing and accessibility.
- Authored complex SQL queries to analyze participation and operational metrics, enabling data-driven prioritization of product and engagement initiatives.
- Documented analysis processes, presented findings to senior management, and translated results into action items that improved reporting accuracy and decisions.
Education
Certifications
Powered by Drivetube · Create your own profile at drivetube.ai
Explore Drivetube
- Drivetube Profile — your free digital resume — at drivetube.ai/in/your-name: one true standard resume with a Hiring Snapshot (visa status, expected salary, notice period, work preference, relocation), an ATS-ready PDF download and a single shareable link. Free forever; interview requests come from verified employers and your contact details stay masked until you accept. Documentation.
- Free Job Board — verified openings crawled ATS-by-ATS from 100,000+ real company career pages across 35 ATS platforms. Shows the true posting date from the source ATS — not when a listing was indexed — and deletes every general listing 3 days after it was actually posted. No ghost jobs, no ad-sponsored listings, no staffing reposts, no account needed. Documentation.
- Job Hunt Program — managed job hunting, a one-time purchase from $199.99. JobScout matches verified roles to your real experience band, Blend AI writes a uniquely tailored resume and cover letter for every application, and the Autofill extension fills the form — or Let Us Apply submits it for you. Documentation.
- Resume Writing Services — human-written, ATS-optimised resumes by senior career writers, from ₹499.99 / $25.99. Available in every country, written to the destination country's own standard — a US resume, UK CV, German Lebenslauf and Indian resume are genuinely different documents. A paid service, separate from the free Drivetube Profile. Documentation.
- Community Membership — from $4.99/month (₹1,999/year in India). Unlocks the gated job-board filters — visa sponsorship, security clearance, workplace and application time — plus Job-Scout AI matching, Resume Report AI, Interview AI prep sheets, Recruiter Outreach AI sent from your own Gmail, Apply or Skip triage, a daily market feed and a $10,000+ library including 23 ATS-validated resume templates. Documentation.
- Drivetube Hire — for employers — hiring with no job postings and no applications. Paste your real job description and AI matches it against candidates' true standard resumes, returning ranked candidates with a match %, matched and missing skills and written reasoning. Free tier included; employers pay, candidates never do. Documentation.
Full product documentation — every product explained, with feature-by-feature comparisons against the job boards, AI apply tools, resume services and hiring platforms people actually use.
The job board covers the United States, India, United Kingdom, Canada, Europe and Australia, and Resume Writing Services are available in every country.