jobs in the wild.

I'm hiring a Senior Data Engineer for a fast-growing AI startup that builds training data for physical AI and robotics. You'll own the full pipeline that turns real-world audio, video and first-person (egocentric) video into datasets that frontier AI labs train on: 🔹 Ingest: multimodal pipelines for audio, video and images at scale 🔹 Lake: AWS data lake on S3, Athena, Glue, Hudi and Lake Formation, at TB to PB scale 🔹 Validate: feed GPU-based validation without starving compute (sharding, manifests, I/O) 🔹 Deliver: delivery-ready datasets, orchestrated with Airflow What you need: • 4+ years in data engineering, owning pipelines end to end in production • Hands-on work with large audio/video pipelines (format conversion, chunking, metadata) • Strong Python and SQL, and production AWS experience • Hudi or Delta Lake, and Airflow • An understanding of how data formats (WebDataset, Parquet, TFRecord) affect GPU throughput Bonus: Ray, SLURM or AWS Batch, Hugging Face datasets, rclone, data lineage tools You'll work directly with the Head of Data and get real ownership from day one. 📩 Interested? DM me, or comment "interested" and I'll reach out. Referrals are welcome too. #hiring #dataengineering #bangalorejobs #AI #robotics #AWS #dataengineer #startupjobs