Building AI infrastructure for emerging markets | Founder @ Mareflux Ā· Rightshift | ex-VW Group, Nissan, DeliveryHero(Now Uber) Ā· Mareflux
3d ago
Senior Data EngineerMareflux
I'm hiring a Senior Data Engineer for a fast-growing AI startup that builds training data for physical AI and robotics.
You'll own the full pipeline that turns real-world audio, video and first-person (egocentric) video into datasets that frontier AI labs train on:
š¹ Ingest: multimodal pipelines for audio, video and images at scale
š¹ Lake: AWS data lake on S3, Athena, Glue, Hudi and Lake Formation, at TB to PB scale
š¹ Validate: feed GPU-based validation without starving compute (sharding, manifests, I/O)
š¹ Deliver: delivery-ready datasets, orchestrated with Airflow
What you need:
ā¢ 4+ years in data engineering, owning pipelines end to end in production
ā¢ Hands-on work with large audio/video pipelines (format conversion, chunking, metadata)
ā¢ Strong Python and SQL, and production AWS experience
ā¢ Hudi or Delta Lake, and Airflow
ā¢ An understanding of how data formats (WebDataset, Parquet, TFRecord) affect GPU throughput
Bonus: Ray, SLURM or AWS Batch, Hugging Face datasets, rclone, data lineage tools
You'll work directly with the Head of Data and get real ownership from day one.
š© Interested? DM me, or comment "interested" and I'll reach out. Referrals are welcome too.
#hiring #dataengineering #bangalorejobs #AI #robotics #AWS #dataengineer #startupjobs
tal saysbuild scalable multimodal data pipelines and aws data lakes for physical ai models
data
senior
in-office
Bangalore
pythonsqlawshudiairflow
comments 0 anon