![]() ![]() “Musixmatch uses Amazon SageMaker to build natural language processing (NLP) and audio processing models and is experimenting with Hugging Face with Amazon SageMaker. As a result, our clients deploying Jurassic-Grande in production are able to serve millions of real-time users on a daily basis, and enjoy the advantage of the improved unit economics without sacrificing user experience.”ĭan Padnos, Vice President Architecture, AI21 Labs The Grande model provides text generation quality on par with our much larger 178 billion parameter model, at a much lower inference cost. As a result, we were able to scale the distributed training jobs easily to hundreds of Nvidia A100 GPUs. Amazon SageMaker made the model training process easier and more efficient, and worked perfectly with DeepSpeed library. Our recently trained Jurassic-Grande (TM) model with 17 billion parameters was trained using Amazon SageMaker. “At AI21 Labs we help businesses and developers use cutting-edge language models to reshape how their users interact with text, with no NLP expertise required. Our developer platform, AI21 Studio, provides access to text generation, smart summarization and even code generation, all based on our family of large language models. Seung Hwan Kim, Vice President and Vision Lab Leader, LG AI Research Using Amazon SageMaker model training and distributed training libraries, we optimized distributed training and trained the model 59% faster-without major modifications to our training code.” ![]() We also needed to continuously manage large-scale data and be flexible to respond to newly acquired data. Specifically, due to the massive computation required to train this super giant AI, efficient parallel processing is very important. Amazon SageMaker was essential in developing EXAONE, because of its scaling and distributed training capabilities. The multi-modality AI allows Tilda to create a new image by itself, with its ability to explore beyond the language it perceives. “We recently debuted Tilda, the AI artist powered by EXAONE, a super giant AI system that can process 250 million high-definition image-text pair datasets. LG AI Research aims to lead the next era of AI by using Amazon SageMaker to train and deploy ML models faster. ![]()
0 Comments
Leave a Reply. |