This afternoon Microsoft announced Brainwave, an FPGA-based system for ultra-low latency deep learning in the cloud. Early benchmarking indicates that when using Intel Stratix 10 FPGAs, Brainwave can sustain 39.5 Teraflops on a large gated recurrent unit without any batching. Microsoft has been pouring resources into FPGAs for a while now, deploying large clusters of the field-programmable… Read More