Kioxia Corporation, a global leader in memory solutions, has announced the open-source release of its cutting-edge All-in-Storage Approximate Nearest Neighbor Search (ANNS) with Product Quantization (AiSAQ) technology. This innovative software delivers a scalable solution for retrieval-augmented generation (RAG) without relying on DRAM, enabling direct search capabilities on SSDs.
Kioxia’s AiSAQ technology is designed to optimize “approximate nearest neighbor” search (ANNS) algorithms, providing substantial performance improvements for generative AI systems—especially in applications that require massive storage, memory, and compute resources. By utilizing SSDs for searches, Kioxia AiSAQ™ offers an efficient method for processing billion-scale datasets at high speed, revolutionizing the way RAG systems handle vast amounts of data.
Transforming Generative AI with Scalable, Cost-Effective Storage Solutions
Generative AI models, particularly large language models (LLMs), have the potential to drive breakthrough innovations across industries. However, their deployment often comes with high infrastructure costs due to the substantial compute, memory, and storage demands of AI systems. A critical phase of AI model training, known as retrieval-augmented generation (RAG), refines these models by incorporating company- or application-specific data to improve accuracy and relevance.
RAG requires an efficient vector database, which stores data in the form of feature vectors, and an ANNS algorithm to retrieve vectors that enhance the model based on similarities with the target vectors. Traditional approaches rely on DRAM to facilitate fast retrieval and ensure high-speed performance for these types of searches.
Kioxia’s AiSAQ technology offers a groundbreaking solution by eliminating the need for DRAM and instead leveraging SSDs for storage, offering significant scalability and speed with minimal memory usage. The solution provides rapid index switching capabilities, making it well-suited for large-scale data environments that require efficient RAG operations.
Also Read: HEAVY.AI Launches Analytics Platform with NVIDIA Grace
Key Advantages of Kioxia AiSAQ Technology
Kioxia AiSAQ technology offers several key benefits for AI systems that rely on RAG, including:
- DRAM-Free Operation: AiSAQ technology allows large-scale vector databases to run efficiently without relying on the limited memory of DRAM. This results in improved performance and cost savings by reducing the need for expensive memory resources.
- Instant Index Launch: The technology eliminates the need to load index data into DRAM, enabling instantaneous launch of vector databases. This capability also allows for seamless switching between user- or application-specific databases on the same server, enhancing the flexibility and efficiency of RAG services.
- Cloud Optimization: Designed for cloud environments, AiSAQ optimizes the storage and management of index data by storing it in disaggregated storage. This approach allows the vector database to be shared across multiple servers, dynamically adjusting search performance to meet the needs of specific users or applications and enabling rapid migration between servers.
- Scalability for Billion-Scale Datasets: AiSAQ is optimized for billion-scale datasets, ensuring scalability with minimal impact on memory usage and delivering fast, efficient search capabilities across large, complex datasets.
Kioxia’s Commitment to AI Innovation and Open-Source Contribution
By releasing AiSAQ technology as open-source software, Kioxia is demonstrating its ongoing commitment to advancing AI development and supporting the global AI community. This open-source release allows researchers, developers, and organizations to leverage Kioxia’s innovative solutions for a wide range of applications in AI, machine learning, and data retrieval.
“Kioxia’s AiSAQ technology provides a scalable, efficient solution for RAG systems that require high-speed, large-scale data processing,” said a company spokesperson. “We are proud to contribute this breakthrough technology to the open-source community, helping to accelerate AI innovation and improve the performance of AI systems worldwide.”
Kioxia’s AiSAQ technology is expected to play a crucial role in enabling the next generation of AI systems by optimizing data retrieval, reducing costs, and enhancing performance. As AI continues to transform industries across the globe, Kioxia remains at the forefront of innovation in memory and storage solutions.
