Design, build, and optimize distributed systems for multimodal pre-training, post-training, inference, data processing, and tokenization at web and petabyte scale.Develop high-throughput pipelines for multimodal data acquisition, preprocessing, filtering, generation, decoding, loading, crawling, visualization, and management.Advance multimodal understanding and generation, including