Distributed training of neural networks

Distributed training of neural networks is something I’ve always wanted to try but couldn’t find much information about it. It seems most people train their models on a single machine. In fact it makes sense because training on a single machine is much more efficient than distributed training. Distributed training incurs additional cost and is […]

Neural network hardware considerations

This post will present some principles to be considered when choosing the hardware that will run some neural net computation, either for training models or making prediction using an existing model (i.e. inference). Need more cores Usually CPU are considered to not perform well enough when it comes to neural network computing and they are […]