The Living Thing / Notebooks : Serious number crunching on Amazon Web Services

I want to do cloud machine learning.

Let’s try this on Amazon Web Services and see what’s awful.

Run through

See How is machine learning on AWS awful this week?, based on my wistful belief in the Keras run-through.

Amazon Machine Images

AWS has launched modern DL VMs at last:

The AWS Deep Learning AMI, now available on AWS Marketplace, lets you run deep learning in the Cloud, at any scale. Launch instances of pre-installed, open source deep learning frameworks, including Apache MXNet, to train sophisticated, custom AI models, experiment with new algorithms, and learn new deep learning skills and techniques. The AWS Deep Learning AMI lets you create managed, auto-scaling clusters of GPUs for large-scale training, or run inference on trained models using the latest versions of MXNet, TensorFlow, Caffe, Theano, Torch, and Keras. With the addition of an Ubuntu version, you have the choice to run on the operating system of your choice. There is no additional charge for the AWS Deep Learning AMI – you pay only for the AWS resources needed to store and run your applications.
  1. NVIDIA supprted Amazon Linux so GPU works but everything else is broken.
  2. Amazon Linux based, updated-ish, so GPU drivers are outdated.
  3. Ubuntu-based, elderly versions which claims to have GPU support, although of course the GPU versions are outdate
  4. Ubuntu, modern versions, no shits given about GPU support

Fine more unsatisfying compromise choices at the “marketplace”.

Docker+Amazon

Docker deployment I could not be arsed working out how do with the GPU stuff.

Misc info