RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! when resuming training

by

There might be an issue with the device parameters are on:

If you need to move a model to GPU via .cuda() , please do so before constructing optimizers for it. Parameters of a model after .cuda() will be different objects with those before the call.
In general, you should make sure that optimized parameters live in consistent locations when optimizers are constructed and used.

More Related Contents:

  1. Best way to save a trained model in PyTorch? [closed]
  2. How do I save a trained model in PyTorch?
  3. How to initialize weights in PyTorch?
  4. How do I initialize weights in PyTorch?
  5. Why do we need to call zero_grad() in PyTorch?
  6. How does Pytorch’s “Fold” and “Unfold” work?
  7. What does model.eval() do in pytorch?
  8. PyTorch NotImplementedError in forward
  9. Pytorch – RuntimeError: Trying to backward through the graph a second time, but the buffers have already been freed
  10. What’s the difference between torch.stack() and torch.cat() functions?
  11. RuntimeError: Input type (torch.FloatTensor) and weight type (torch.cuda.FloatTensor) should be the same
  12. How do I split a custom dataset into training and test datasets?
  13. PyTorch Binary Classification – same network structure, ‘simpler’ data, but worse performance?
  14. How to get the location of all text present in an image using OpenCV?
  15. Heroku: slug size too large after installing Pytorch
  16. ValueError: math domain error
  17. How do I load a caffe model and convert to a numpy array?
  18. How to feed caffe multi label data in HDF5 format?
  19. How to set layer-wise learning rate in Tensorflow?
  20. How do I print the model summary in PyTorch?
  21. ‘int’ object has no attribute ‘__getitem__’
  22. How do I check if PyTorch is using the GPU?
  23. Pytorch RuntimeError: The size of tensor a (4) must match the size of tensor b (3) at non-singleton dimension 0
  24. keras: how to save the training history attribute of the history object
  25. Is .data still useful in pytorch?
  26. ValueError: Tensor must be from the same graph as Tensor with Bidirectinal RNN in Tensorflow
  27. Data Augmentation in PyTorch
  28. how to implement custom metric in keras?
  29. Install PyTorch from requirements.txt
  30. Pytorch ValueError: optimizer got an empty parameter list

Leave a Comment