jobs in the wild.

This is a full-time remote role, and needs strong hands-on experience with Databrick, python, Azure and AWS. You’ll be building and owning data pipelines end-to-end — ingestion to curated, analytics-ready data — on a modern lakehouse stack. Medallion architecture, Delta Lake, Unity Catalog, DLT, PySpark. The works. What we’re looking for: 1. 5+ years in data engineering (real experience, not resume padding) 2. Deep Databricks hands-on: Spark, Delta Lake, Workflows, Unity Catalog, cluster tuning 3. Expert-level Python: OOP, packaging, testing, the full software engineering discipline 4. Strong Azure (ADLS Gen2, ADF, Event Hubs) and AWS (S3, Glue, Lambda, Kinesis) 5. Can work with a minimum 4-hour daily overlap with US Eastern Time Candidate's preferred location: Mumbai or Pune, though the role is remote. If this sounds like you, send over your resume and a short note on your most relevant Databricks and Python project to connect@varysdi.com (No DMs). High intent only. AI slop is deeply discouraged and frowned upon! If anyone in your network comes to mind after reading this, we appreciate you pointing them our way. #Hiring #DataEngineering #Databricks #Python #Azure #AWS #DataPlatform #RemoteWork #LakeHouse #PySpark #TechHiring #DeltaLake #DataEngineer Varys DI Parth Waidya

I'm hiring a Senior Data Engineer for a fast-growing AI startup that builds training data for physical AI and robotics. You'll own the full pipeline that turns real-world audio, video and first-person (egocentric) video into datasets that frontier AI labs train on: 🔹 Ingest: multimodal pipelines for audio, video and images at scale 🔹 Lake: AWS data lake on S3, Athena, Glue, Hudi and Lake Formation, at TB to PB scale 🔹 Validate: feed GPU-based validation without starving compute (sharding, manifests, I/O) 🔹 Deliver: delivery-ready datasets, orchestrated with Airflow What you need: • 4+ years in data engineering, owning pipelines end to end in production • Hands-on work with large audio/video pipelines (format conversion, chunking, metadata) • Strong Python and SQL, and production AWS experience • Hudi or Delta Lake, and Airflow • An understanding of how data formats (WebDataset, Parquet, TFRecord) affect GPU throughput Bonus: Ray, SLURM or AWS Batch, Hugging Face datasets, rclone, data lineage tools You'll work directly with the Head of Data and get real ownership from day one. 📩 Interested? DM me, or comment "interested" and I'll reach out. Referrals are welcome too. #hiring #dataengineering #bangalorejobs #AI #robotics #AWS #dataengineer #startupjobs