Venkata Sai Vikram Karthik Krovi
Professional Summary
Data Engineer with 2 years of experience building ETL/ELT pipelines, automating web ingestion, and delivering clean, production-ready datasets using Python, PySpark, AWS, and PostgreSQL. Skilled in pipeline design, data validation, and API-backed delivery to support analytics and ML workflows.
Technical Skills
Work Experience
- Designed and implemented a real-time ingestion pipeline for OHLC market feeds using Python and FastAPI to receive, validate, and persist ticks into PostgreSQL.
- Built ETL transformations with Pandas and PySpark to normalize timestamps, handle missing values, and enforce a consistent schema for downstream consumers.
- Implemented record-level data quality checks and anomaly flagging to prevent malformed or outlier ticks from corrupting analytics datasets.
- Exposed processed market data via FastAPI endpoints to enable analytics and reporting workflows without manual extraction steps.
- Documented pipeline architecture, data contracts, and runbooks to improve handoffs and maintainability for future engineers.
- Containerized services with Docker and managed code and CI via GitHub to ensure reproducible deployments and collaboration.
- Built ETL pipelines on AWS using S3, AWS Glue and PySpark to ingest, transform, and store structured and semi-structured datasets.
- Developed PySpark transformations to clean, standardize fields, and implement partitioning strategies for improved query performance.
- Applied secure access patterns using IAM and implemented S3 lifecycle practices to protect sensitive data and optimize storage.
- Added data quality checks and validation steps within Glue jobs to prevent propagation of corrupt records downstream.
- Cataloged datasets and metadata with Glue Data Catalog to enable discoverability and reproducible consumption by analysts.
- Used SQL and Databricks SQL for validation queries and exploratory checks to verify pipeline outputs against source expectations.
- Performed end-to-end data cleaning and transformation using Python, Pandas, and SQL to prepare multiple business datasets for analysis.
- Authored SQL queries and views in PostgreSQL to validate joins, aggregations, and derived KPI metrics used by stakeholders.
- Conducted exploratory data analysis and built visualizations in Tableau and Power BI to identify trends and anomalies for stakeholders.
- Automated repetitive preprocessing tasks with parameterized Python scripts to reduce manual effort and accelerate analyses.
- Documented data lineage and preprocessing steps to ensure reproducibility and ease of handoff to analytics teams.
- Collaborated with product and business stakeholders to translate requirements into data specifications and KPI definitions.
- Evaluated and annotated human-robot interaction datasets against defined quality standards to ensure label accuracy and consistency for model training.
- Built validation pipelines in Python to run consistency checks and remove noisy annotations prior to handoff to modeling teams.
- Created annotation guidelines and sample review workflows to increase annotator agreement and reduce rework during labeling rounds.
- Managed dataset versioning and storage workflows, using S3 and PostgreSQL to maintain traceability across annotation iterations.
- Implemented automated sanity checks (format, range, completeness) to catch issues before downstream consumption by engineers.
- Produced QA reports and feedback loops for annotators and data engineers to continuously improve dataset quality and readiness.
Projects
- Built an end-to-end pipeline to extract, clean, and transform financial market data using Python and PySpark.
- Implemented rule-based risk-flagging logic to mark suspicious records and maintain an audit trail for analysts.
- Validated processed data using SQL queries against PostgreSQL and documented each processing stage for reproducibility.
- Developed Selenium-based scrapers to extract data from dynamic websites and integrated extraction into Airbyte ETL workflows.
- Stored cleaned, canonical records in PostgreSQL and implemented retry, deduplication, and normalization logic for robustness.
- Scheduled and monitored pipelines and implemented error-handling to reduce manual intervention during collection.
- Gathered business requirements and translated them into KPIs, data models, and dashboard wireframes for stakeholders.
- Prepared datasets with SQL-based ETL transformations and automated refresh schedules for dashboard consumption.
- Delivered interactive dashboards in Power BI and Tableau to support market intelligence and business decision-making.
Education
Certifications
Powered by Drivetube · Create your own profile at drivetube.ai
Everything on Drivetube
Six products, two of them free forever. Start wherever you are.
Your free digital resume
at drivetube.ai/in/your-name: one true standard resume with a Hiring Snapshot (visa status, expected salary, notice period, work preference, relocation), an ATS-ready PDF download and a single shareable link. Free forever; interview requests come from verified employers and your contact details stay masked until you accept.
Documentation- Free Job BoardFree
Verified jobs, posted in the last 3 days
verified openings crawled ATS-by-ATS from 160,000+ real company career pages across 50+ ATS platforms. Shows the true posting date from the source ATS — not when a listing was indexed — and deletes every general listing 3 days after it was actually posted. No ghost jobs, no ad-sponsored listings, no staffing reposts, no account needed.
Documentation - Resume Writing ServicesFrom $25.99
Written by senior career writers
human-written, ATS-optimised resumes by senior career writers, from ₹499.99 / $25.99. Available in every country, written to the destination country's own standard — a US resume, UK CV, German Lebenslauf and Indian resume are genuinely different documents. A paid service, separate from the free Drivetube Profile.
Documentation - Drivetube OneFrom $39.99 / 3 mo
Daily matched jobs, tailored resumes, or we apply for you
Drivetube's paid service. Community sends daily Jobsheets of fresh jobs matched to your profile on WhatsApp and email, with the Drivetube Community ($39.99 for 3 months or $69.99 for 6 months; ₹999 or ₹1,899 in India). Jobhunt is one-time application credits with Community included: one credit tailors one resume and its cover letter (100 for $99 with 3 months of Community, 250 for $199 with 6 months). Let Us Apply is an add-on to Jobhunt: a human expert applies 250 times for you on your credits ($0.60 each, $150). Everything lives on one dashboard at drivetube.ai/drivetubeone.
Documentation - Drivetube HireFree tier
For employers — no job postings, no applications
hiring with no job postings and no applications. Paste your real job description and AI matches it against candidates' true standard resumes, returning ranked candidates with a match %, matched and missing skills and written reasoning. Free tier included; employers pay, candidates never do.
Documentation
- Documentation
every product explained in full, with feature-by-feature comparisons against the job boards, AI apply tools, resume services and hiring platforms people actually use.
- Playbooks
tactical job-search guides. Each post is one named tactic with the situation it applies to, the exact steps, a copy-paste message and honest failure modes. Free, no account.
The job board covers the United States, India, United Kingdom, Canada, Europe and Australia, and Resume Writing Services are available in every country.
Pricing is identical on the web, iOS and Android — no app-store markup. Monthly Community membership is purchased in the iOS app only; the website sells annual plans. The Android app has no in-app purchase, so Android members subscribe on drivetube.ai and then sign in to the app with full access. Membership follows your account, not your device.