Perplexity’s clever trick makes trillion-parameter AI models run on cheap hardware
Perplexity has developed software that makes massive AI models practical on cheaper, older hardware. Their optimizations specifically target Amazon’s Elastic Fabric Adapter networking technology. This could democratize access to cutting-edge AI models.