The AI TOP allows for local training of AI models. (Image Credit: Gigabyte).
Key Highlights
New Delhi: Gigabyte has announced AI TOP at Computex 2024. The machine is aimed at local AI, not only for inference but also for training the models themselves, which is a compute-intensive task. The idea is to provide users with everything that they need to train and operate AI models right on their desk. The introduction of AI TOP follows the introduction of the Gigabyte AI PC at CES 2024.
The AI TOP system is an all-round solution for training AI models locally, featuring the AI TOP Utility and the AI TOP Tutor apart from the hardware. The AI TOP Utility has a user friendly interface, and supports up to 236 Billion parameter large language models while maintaining privacy and security.
The hardware is flexible and configured for upgradability, compared to traditional training solutions such as the cloud. The system is also designed for standard electrical systems, and is power-efficient. The AI TOP Tutor provides comprehensive consultation for AI TOP with intuitive set-up guidance and technical support.
A variety of Gigabyte products are featured in the AI TOP hardware, including motherboards, graphics cards, SSDs and power supply units. Gigabyte also revealed the Radeon PRO W7900 AI TOP 48G and the Radeon PRO W7800 32G graphics cards, both of which have been developed in collaboration with AMD.
Gigabyte is the first and only graphics card partner on the market that has collaborated with AMD on the Radeon Pro series. CEO of Gigabyte, Eddie Lin said, “Gigabyte’s persistent pursuit in quality and reliability strengthens our partnership with leading silicon giants in making the world better with AI.”
One of the biggest benefits of running AI models locally is the privacy and security that it offers. The data is not uploaded to cloud servers, removing any chance of the data being misused. Depending on the power and speed of the hardware, the responses can also be faster than cloud-based alternatives.
Follow us on social media
