RTX AI Toolkit and RTX AI NIMS: NVIDIA’s Computex is all about artificial intelligence

NVIDIA’s Computex 2024 officially kicked off with the keynote hosted by Jensen Huang. At center stage is, once again, artificial intelligence and the first announcement from the green team is dedicated to the implementation of the latter.
NVIDIA has in fact presented RTX AI Toolkit, a tool for developers which simplifies the integration of AI-related features and which leverages the specific hardware of the American company, with the potential to revolutionize the development of professional applications and video games.

The development of interactive characters based on AI continues and after the announcement of NVIDIA ACE in the last edition it is now the turn of NVIDIA NIMS, “digital humans” that exploit the latest NVIDIA technologies. Let’s find out all the details together.

NVIDIA RTX AI Toolkit, simple and fast AI

After showing some of the RTX AI laptops that will be presented during Computex 2024, NVIDIA has unveiled a new tool for artificial intelligence dedicated to developers: NVIDIA RTX AI Toolkit is a collection of tools and SDKs that help developers customize , optimize and deploy AI capabilities in Windows applications, and orchestrate inference between PC and cloud, depending on the needs of the application and the capabilities of the PC.

The potential of the new toolkit was showcased using the example of an LLM integrated into a role-playing game: according to NVIDIA technicians, following the normal implementation process via a pre-trained model, the responses of an NPC are generic, not to mention the great computing power necessary for the correct functioning of the interaction.

With the intervention of NVIDIA RTX AI Toolkit the answers are quick, engaging and everything can work locally thanks to an NVIDIA GeForce RTX 4050 Laptop GPU.
In short, according to NVIDIA, the RTX AI toolkit will help professionals bridge the gap between the new and powerful artificial intelligence models available and the needs of application and video game developers.

NVIDIA RTX AI NIMS and ACE

NIMS, an acronym for NVIDIA Inference Microservice, find a direct application thanks to NVIDIA ACE, a tool that is capable of generating interactive non-player characters through the use of artificial intelligence.
The pre-trained AI models, combined with NVIDIA ACE technologies, give life to real “digital humans” who can interact with users and which find application in the most disparate fields: from medicine to gaming, through commercial services.

Thanks to the advanced capabilities of RTX GPUs, NIMS can take on extremely realistic appearances, with detailed textures and ray traced lighting and can run locally or in the cloud.