The RStudio template provides a fully featured Ubuntu 16.04 desktop in the cloud for doing deep learning with R. The machine supports the use of RStudio both within a Desktop environment as well as via RStudio Server (running through an SSH tunnel).
NVIDIA GPU libraries (CUDA 8.0 and cuDNN 6.0) are pre-installed, along with the GPU version of TensorFlow v1.4. The R keras, tfestimators, and tensorflow packages are also pre-installed, as are all of the packages from the tidyverse (dplyr, ggplot2, etc.).
Full instructions for using the template can be found here: https://tensorflow.rstudio.com/tools/cloud_desktop_gpu.html