Skip to content

Ramyasri Papolu

Data Engineer • United States • linkedin.com/••••• • drivetube.ai/•••••

Professional Summary

Data Engineer with 5+ years of hands-on expertise in designing, developing, and optimizing large-scale data pipelines across AWS, Azure, and GCP. Proficient in PySpark, SQL, ETL, Airflow, and cloud-based data warehousing with strong proficiency in automation, orchestration, and real-time streaming. Delivered a 35% reduction in data latency through end-to-end pipeline optimization and workflow enhancements. Collaborated with teams to ensure reliable, high-quality data for analytics and business intelligence.

Technical Skills

Programming Language: Python,Scala,Bash
Databases: PostgreSQL,MySQL,Oracle,Microsoft SQL Server,Snowflake,Amazon DynamoDB,Azure Synapse,Google BigQuery
Cloud Platforms: Kinesis,AWS,S3,AWS Athena,Lambda,Microsoft Azure,GCP
Version Control & Development Tools: Composer,Git,GitHub
DevOps & Infrastructure: AWS CloudFormation,Jenkins,GitLab CI/CD,Azure DevOps,Terraform
Messaging & Monitoring: Google Cloud Pub/Sub,Apache Kafka,Kafka Streams
Data Engineering & Processing: Apache Spark,PySpark,Apache Flink,Spark SQL,Apache Airflow,EMR,Azure Databricks
Data Integration & ETL: Informatica,Apache NiFi,SSIS,ADF,Google Cloud Dataflow

Work Experience

Catalent
Kansas City, Missouri, USA
Azure Data Engineer
Mar 2025 – Present
Global pharmaceutical CDMO; built Azure data pipelines powering cross-team analytics and regulatory-compliant reporting.
Tech Stack: Azure Data Factory, PySpark, Azure Databricks, Azure Functions, PowerShell, SQL Server
  • Designed and implemented end-to-end ETL pipelines in Azure Data Factory, reducing data latency by 35%.
  • Developed and optimized data ingestion workflows from SQL Server, improving data availability and reliability across teams.
  • Resolved performance bottlenecks in large-scale data pipelines using PySpark and Azure Databricks, enhancing processing efficiency by 40%.
  • Led cross-functional collaboration with QA and business teams, guiding a 4 member team, ensuring compliant data delivery for analytics and reporting.
  • Automated data transformation and monitoring using Azure Functions, Databricks, and PowerShell scripts, cutting manual intervention by 50%.
Mastercard
Ofallon, Missouri, USA
AWS Data Engineer
May 2024 – Feb 2025
Multinational payments processor; engineered AWS data infrastructure ingesting transaction data to drive analytics, reporting and streaming insights.
Tech Stack: AWS Glue, Python, Amazon Redshift, Kinesis Data Streams, AWS Lambda, Informatica PowerCenter, AWS CloudWatch, S3
  • Engineered scalable ETL pipelines to process transaction and payment data, improving data ingestion speed by 35% using AWS Glue and Python.
  • Optimized Amazon Redshift warehouse, ensuring high availability of financial datasets for cross-functional analytics, supporting 50+ business reports.
  • Enhanced streaming transaction processing by implementing Kinesis Data Streams and Lambda, improving data reliability by 25%.
  • Maintained ETL workflows using Informatica PowerCenter, enabling seamless integration of multi-source financial datasets and ensuring data consistency across the Redshift warehouse.
  • Implemented automated data validation and monitoring workflows using AWS CloudWatch, S3, and Python, reducing manual intervention by 40% and improving pipeline efficiency.
Warner Bros. Discovery
Hyderabad, India
GCP Data Engineer
Jan 2022 – Nov 2023
Major media & entertainment conglomerate; optimized GCP pipelines merging streaming consumption data for near-real-time marketing analytics.
Tech Stack: BigQuery, Cloud Dataflow, Python, Cloud Composer, Streaming & Batch Pipelines, Pub/Sub
  • Optimized data integration pipelines on BigQuery to integrate media consumption data, improving query performance by 30%.
  • Designed data models and ingestion workflows using Cloud Dataflow across streaming and batch pipelines, enabling real-time marketing analytics.
  • Rectified complex data inconsistencies in content metadata by implementing automated cleansing scripts in Python, reducing error rates by 25%.
  • Integrated Pub/Sub messaging with Cloud Dataflow pipelines to support real-time event streaming, enhancing data processing speed and enabling near-instant analytics.
  • Streamlined data pipeline operations by implementing automated job scheduling and logging in Cloud Composer, reducing manual intervention by 40%.
PayPal
Hyderabad, India
Data Engineer
Jun 2020 – Dec 2021
Global digital payments platform; delivered scalable warehouses and ETL pipelines supporting transaction and user analytics across multiple data marts.
Tech Stack: Python, SQL, Spark, PostgreSQL, Jenkins, Snowflake, PySpark, Airflow
  • Engineered high-performance ETL pipelines to process transaction and user data, improving data throughput by 35% using Python, SQL, and Spark.
  • Enhanced complex SQL queries and optimized PostgreSQL database workflows across 10+ data marts, reducing report generation time and enabling faster analytics.
  • Implemented CI/CD workflows using Jenkins to automate ETL job deployments and pipeline validations, reducing release cycles by 40% and ensuring reliable production data processing.
  • Architected Snowflake data warehouses for transaction and user datasets, implementing clustering and partitioning strategies to improve query performance and support scalable analytics.
  • Implemented data transformations and aggregations using PySpark and Airflow, streamlining daily ETL processes and boosting efficiency by 30%.

Education

Saint Louis University
Master of Science in Information Systems • Saint Louis, Mo, USA • Jan 2024 – Dec 2025

Powered by Drivetube · Create your own profile at drivetube.ai

Everything on Drivetube

Six products, two of them free forever. Start wherever you are.

Read the docs →
  • Your free digital resume

    at drivetube.ai/in/your-name: one true standard resume with a Hiring Snapshot (visa status, expected salary, notice period, work preference, relocation), an ATS-ready PDF download and a single shareable link. Free forever; interview requests come from verified employers and your contact details stay masked until you accept.

    Documentation
  • Verified jobs, posted in the last 3 days

    verified openings crawled ATS-by-ATS from 160,000+ real company career pages across 50+ ATS platforms. Shows the true posting date from the source ATS — not when a listing was indexed — and deletes every general listing 3 days after it was actually posted. No ghost jobs, no ad-sponsored listings, no staffing reposts, no account needed.

    Documentation
  • Written by senior career writers

    human-written, ATS-optimised resumes by senior career writers, from ₹499.99 / $25.99. Available in every country, written to the destination country's own standard — a US resume, UK CV, German Lebenslauf and Indian resume are genuinely different documents. A paid service, separate from the free Drivetube Profile.

    Documentation
  • Drivetube OneFrom $39.99 / 3 mo

    Daily matched jobs, tailored resumes, or we apply for you

    Drivetube's paid service. Community sends daily Jobsheets of fresh jobs matched to your profile on WhatsApp and email, with the Drivetube Community ($39.99 for 3 months or $69.99 for 6 months; ₹999 or ₹1,899 in India). Jobhunt is one-time application credits with Community included: one credit tailors one resume and its cover letter (100 for $99 with 3 months of Community, 250 for $199 with 6 months). Let Us Apply is an add-on to Jobhunt: a human expert applies 250 times for you on your credits ($0.60 each, $150). Everything lives on one dashboard at drivetube.ai/drivetubeone.

    Documentation
  • For employers — no job postings, no applications

    hiring with no job postings and no applications. Paste your real job description and AI matches it against candidates' true standard resumes, returning ranked candidates with a match %, matched and missing skills and written reasoning. Free tier included; employers pay, candidates never do.

    Documentation
  • Documentation

    every product explained in full, with feature-by-feature comparisons against the job boards, AI apply tools, resume services and hiring platforms people actually use.

  • Playbooks

    tactical job-search guides. Each post is one named tactic with the situation it applies to, the exact steps, a copy-paste message and honest failure modes. Free, no account.

The job board covers the United States, India, United Kingdom, Canada, Europe and Australia, and Resume Writing Services are available in every country.

Pricing is identical on the web, iOS and Android — no app-store markup. Monthly Community membership is purchased in the iOS app only; the website sells annual plans. The Android app has no in-app purchase, so Android members subscribe on drivetube.ai and then sign in to the app with full access. Membership follows your account, not your device.