6thWave: AI News Hub

Generative AI (genAI) demands substantial resources including compute cycles, data storage, and network bandwidth, which often results in high costs. Innovative IT leaders, however, are finding ways to manage these expenses effectively. Initiatives vary from using cloud-based solutions to setting up on-premises infrastructures. However, the challenge lies in the high operational costs, which do not always align with the uncertain payback of genAI projects. To address this, some leaders are shifting towards using smaller language models and hybrid infrastructures, which can provide better returns on investment. For instance, Northwestern Medicine reduced their genAI project costs by opting for small language models that require less infrastructure. This approach not only saved costs but also enhanced the efficiency of their radiology teams by speeding up X-ray image interpretations.

Source.