Ramyasri Papolu
Professional Summary
Data Engineer with 5+ years of hands-on expertise in designing, developing, and optimizing large-scale data pipelines across AWS, Azure, and GCP. Proficient in PySpark, SQL, ETL, Airflow, and cloud-based data warehousing with strong proficiency in automation, orchestration, and real-time streaming. Delivered a 35% reduction in data latency through end-to-end pipeline optimization and workflow enhancements. Collaborated with teams to ensure reliable, high-quality data for analytics and business intelligence.
Technical Skills
Work Experience
- Designed and implemented end-to-end ETL pipelines in Azure Data Factory, reducing data latency by 35%.
- Developed and optimized data ingestion workflows from SQL Server, improving data availability and reliability across teams.
- Resolved performance bottlenecks in large-scale data pipelines using PySpark and Azure Databricks, enhancing processing efficiency by 40%.
- Led cross-functional collaboration with QA and business teams, guiding a 4 member team, ensuring compliant data delivery for analytics and reporting.
- Automated data transformation and monitoring using Azure Functions, Databricks, and PowerShell scripts, cutting manual intervention by 50%.
- Engineered scalable ETL pipelines to process transaction and payment data, improving data ingestion speed by 35% using AWS Glue and Python.
- Optimized Amazon Redshift warehouse, ensuring high availability of financial datasets for cross-functional analytics, supporting 50+ business reports.
- Enhanced streaming transaction processing by implementing Kinesis Data Streams and Lambda, improving data reliability by 25%.
- Maintained ETL workflows using Informatica PowerCenter, enabling seamless integration of multi-source financial datasets and ensuring data consistency across the Redshift warehouse.
- Implemented automated data validation and monitoring workflows using AWS CloudWatch, S3, and Python, reducing manual intervention by 40% and improving pipeline efficiency.
- Optimized data integration pipelines on BigQuery to integrate media consumption data, improving query performance by 30%.
- Designed data models and ingestion workflows using Cloud Dataflow across streaming and batch pipelines, enabling real-time marketing analytics.
- Rectified complex data inconsistencies in content metadata by implementing automated cleansing scripts in Python, reducing error rates by 25%.
- Integrated Pub/Sub messaging with Cloud Dataflow pipelines to support real-time event streaming, enhancing data processing speed and enabling near-instant analytics.
- Streamlined data pipeline operations by implementing automated job scheduling and logging in Cloud Composer, reducing manual intervention by 40%.
- Engineered high-performance ETL pipelines to process transaction and user data, improving data throughput by 35% using Python, SQL, and Spark.
- Enhanced complex SQL queries and optimized PostgreSQL database workflows across 10+ data marts, reducing report generation time and enabling faster analytics.
- Implemented CI/CD workflows using Jenkins to automate ETL job deployments and pipeline validations, reducing release cycles by 40% and ensuring reliable production data processing.
- Architected Snowflake data warehouses for transaction and user datasets, implementing clustering and partitioning strategies to improve query performance and support scalable analytics.
- Implemented data transformations and aggregations using PySpark and Airflow, streamlining daily ETL processes and boosting efficiency by 30%.
Education
Powered by Drivetube · Create your own profile at drivetube.ai
Everything on Drivetube
Six products, two of them free forever. Start wherever you are.
Your free digital resume
at drivetube.ai/in/your-name: one true standard resume with a Hiring Snapshot (visa status, expected salary, notice period, work preference, relocation), an ATS-ready PDF download and a single shareable link. Free forever; interview requests come from verified employers and your contact details stay masked until you accept.
Documentation- Free Job BoardFree
Verified jobs, posted in the last 3 days
verified openings crawled ATS-by-ATS from 160,000+ real company career pages across 50+ ATS platforms. Shows the true posting date from the source ATS — not when a listing was indexed — and deletes every general listing 3 days after it was actually posted. No ghost jobs, no ad-sponsored listings, no staffing reposts, no account needed.
Documentation - Resume Writing ServicesFrom $25.99
Written by senior career writers
human-written, ATS-optimised resumes by senior career writers, from ₹499.99 / $25.99. Available in every country, written to the destination country's own standard — a US resume, UK CV, German Lebenslauf and Indian resume are genuinely different documents. A paid service, separate from the free Drivetube Profile.
Documentation - Drivetube OneFrom $39.99 / 3 mo
Daily matched jobs, tailored resumes, or we apply for you
Drivetube's paid service. Community sends daily Jobsheets of fresh jobs matched to your profile on WhatsApp and email, with the Drivetube Community ($39.99 for 3 months or $69.99 for 6 months; ₹999 or ₹1,899 in India). Jobhunt is one-time application credits with Community included: one credit tailors one resume and its cover letter (100 for $99 with 3 months of Community, 250 for $199 with 6 months). Let Us Apply is an add-on to Jobhunt: a human expert applies 250 times for you on your credits ($0.60 each, $150). Everything lives on one dashboard at drivetube.ai/drivetubeone.
Documentation - Drivetube HireFree tier
For employers — no job postings, no applications
hiring with no job postings and no applications. Paste your real job description and AI matches it against candidates' true standard resumes, returning ranked candidates with a match %, matched and missing skills and written reasoning. Free tier included; employers pay, candidates never do.
Documentation
- Documentation
every product explained in full, with feature-by-feature comparisons against the job boards, AI apply tools, resume services and hiring platforms people actually use.
- Playbooks
tactical job-search guides. Each post is one named tactic with the situation it applies to, the exact steps, a copy-paste message and honest failure modes. Free, no account.
The job board covers the United States, India, United Kingdom, Canada, Europe and Australia, and Resume Writing Services are available in every country.
Pricing is identical on the web, iOS and Android — no app-store markup. Monthly Community membership is purchased in the iOS app only; the website sells annual plans. The Android app has no in-app purchase, so Android members subscribe on drivetube.ai and then sign in to the app with full access. Membership follows your account, not your device.