Power Generative AI with Performance-optimized Llama 3.1 NVIDIA NIMs

Опубликовано: 23 Июль 2024
на канале: NVIDIA Developer
1,891
45

The Llama 3.1 collection of open models is now optimized with NVIDIA TensorRT-LLM for superior throughput and latency. It is ideal for synthetic data generation, distillation, translation and coding and available as NVIDIA NIM inference microservices to run on 100+ million GPUs across data centers, clouds, and workstations.

Discover how these innovations can elevate your AI projects and drive success in your development journey.

🚀✨Get started today on https://ai.nvidia.com

Join the NVIDIA Developer Program: https://nvda.ws/3OhiXfl

Read and subscribe to the NVIDIA Technical Blog: https://nvda.ws/3XHae9F

#AI #TensorRT #Llama3 #DeveloperCommunity #NVIDIA #developer #LLM #AIatMeta