Tharun Pagadala
Professional Summary
Data Engineer with 5 years of experience designing, developing, and supporting AWS and Azure cloud-based data solutions for healthcare, banking, and enterprise reporting. Experienced building scalable ETL/ELT pipelines using AWS Glue and Azure Data Factory with Python and PySpark to ingest, transform, and deliver governed datasets. Proven ability to optimize SQL and partitioning strategies to reduce processing time and improve reporting SLAs while producing dimensional models for business analytics. Skilled in automating validation, monitoring and CI/CD using Git, Azure DevOps, and CloudWatch to improve deployment reliability. Delivered Power BI reporting layers and prepared AI-ready datasets supporting predictive analytics and responsible-AI initiatives. Comfortable working in Agile teams, owning end-to-end data pipelines from ingestion to consumption.
Technical Skills
Work Experience
- Architected and implemented AWS Glue ETL jobs in Python to ingest claims and member datasets into Amazon S3 and load cleansed tables into PostgreSQL for downstream analytics.
- Developed reusable PySpark transformations to normalize semi-structured claims JSON into Parquet, reducing downstream transformation code by 40%.
- Optimized partition strategies and SQL query patterns, cutting aggregate job runtime from 60 to 38 minutes.
- Built AWS Lambda-driven file validation and metadata pipelines to automate schema checks and incremental loads for daily ingestion processes.
- Instrumented CloudWatch monitoring and automated alerts for Glue job failures to improve operational visibility and triage.
- Delivered dimensional datasets consumed by 200+ Power BI reports supporting claims, provider, and member analytics.
- Drove Git-based CI/CD deployments and peer code reviews to standardize Glue job releases and reduce deployment issues.
- Designed and developed Azure Data Factory pipelines to ingest transactional banking data into Azure SQL Database for centralized reporting.
- Authored stored procedures and optimized T-SQL queries using CTEs and window functions, reducing average report query latency by 15 minutes.
- Built Power BI reports and automated 30+ scheduled reports using Python scripts, accelerating stakeholder access to financial dashboards.
- Implemented data validation and reconciliation routines across flat files and relational sources to enforce source-to-target consistency.
- Automated deployments and version control using Azure DevOps and Git to improve release traceability and rollback capability.
- Performed data profiling and cleansing that reduced manual reporting effort by 25% and improved dataset accuracy for finance teams.
- Collected business requirements and translated analytical needs into SQL queries and reporting datasets for operational teams.
- Developed SQL scripts and stored procedures to extract, transform, and validate enterprise data using joins and CTEs.
- Optimized frequently executed SQL queries, reducing report execution time by 22%.
- Created Power BI reports and standardized data models deployed across 10+ departments to improve reporting consistency.
- Performed reconciliations between source systems and warehouse tables and led root-cause analysis to resolve production defects within SLA windows.
- Documented mapping specifications, operational runbooks, and validation scripts to accelerate onboarding and supportability.
Education
Certifications
Powered by Drivetube · Create your own profile at drivetube.ai
Everything on Drivetube
Six products, two of them free forever. Start wherever you are.
Your free digital resume
at drivetube.ai/in/your-name: one true standard resume with a Hiring Snapshot (visa status, expected salary, notice period, work preference, relocation), an ATS-ready PDF download and a single shareable link. Free forever; interview requests come from verified employers and your contact details stay masked until you accept.
Documentation- Free Job BoardFree
Verified jobs, posted in the last 3 days
verified openings crawled ATS-by-ATS from 160,000+ real company career pages across 50+ ATS platforms. Shows the true posting date from the source ATS — not when a listing was indexed — and deletes every general listing 3 days after it was actually posted. No ghost jobs, no ad-sponsored listings, no staffing reposts, no account needed.
Documentation - Resume Writing ServicesFrom $25.99
Written by senior career writers
human-written, ATS-optimised resumes by senior career writers, from ₹499.99 / $25.99. Available in every country, written to the destination country's own standard — a US resume, UK CV, German Lebenslauf and Indian resume are genuinely different documents. A paid service, separate from the free Drivetube Profile.
Documentation - Drivetube OneFrom $39.99 / 3 mo
Daily matched jobs, tailored resumes, or we apply for you
Drivetube's paid service. Community sends daily Jobsheets of fresh jobs matched to your profile on WhatsApp and email, with the Drivetube Community ($39.99 for 3 months or $69.99 for 6 months; ₹999 or ₹1,899 in India). Jobhunt is one-time application credits with Community included: one credit tailors one resume and its cover letter (100 for $99 with 3 months of Community, 250 for $199 with 6 months). Let Us Apply is an add-on to Jobhunt: a human expert applies 250 times for you on your credits ($0.60 each, $150). Everything lives on one dashboard at drivetube.ai/drivetubeone.
Documentation - Drivetube HireFree tier
For employers — no job postings, no applications
hiring with no job postings and no applications. Paste your real job description and AI matches it against candidates' true standard resumes, returning ranked candidates with a match %, matched and missing skills and written reasoning. Free tier included; employers pay, candidates never do.
Documentation
- Documentation
every product explained in full, with feature-by-feature comparisons against the job boards, AI apply tools, resume services and hiring platforms people actually use.
- Playbooks
tactical job-search guides. Each post is one named tactic with the situation it applies to, the exact steps, a copy-paste message and honest failure modes. Free, no account.
The job board covers the United States, India, United Kingdom, Canada, Europe and Australia, and Resume Writing Services are available in every country.
Pricing is identical on the web, iOS and Android — no app-store markup. Monthly Community membership is purchased in the iOS app only; the website sells annual plans. The Android app has no in-app purchase, so Android members subscribe on drivetube.ai and then sign in to the app with full access. Membership follows your account, not your device.