How to use 2D Arrays in CUDA?

by

How to allocate 2D array: 

int main(){
#define BLOCK_SIZE 16
#define GRID_SIZE 1
int d_A[BLOCK_SIZE][BLOCK_SIZE];
int d_B[BLOCK_SIZE][BLOCK_SIZE];

/* d_A initialization */

dim3 dimBlock(BLOCK_SIZE, BLOCK_SIZE); // so your threads are BLOCK_SIZE*BLOCK_SIZE, 256 in this case
dim3 dimGrid(GRID_SIZE, GRID_SIZE); // 1*1 blocks in a grid

YourKernel<<<dimGrid, dimBlock>>>(d_A,d_B); //Kernel invocation
}

How to traverse that array:

__global__ void YourKernel(int d_A[BLOCK_SIZE][BLOCK_SIZE], int d_B[BLOCK_SIZE][BLOCK_SIZE]){
int row = blockIdx.y * blockDim.y + threadIdx.y;
int col = blockIdx.x * blockDim.x + threadIdx.x;
if (row >= h || col >= w)return;
/* whatever you wanna do with d_A[][] and d_B[][] */
}

i hope this is helpful

and also you can refer to CUDA Programming Guide page 22 about Matrix Multiplication

More Related Contents:

  1. CUDA compute capability requirements
  2. Cuda atomics change flag
  3. Thrust inside user written kernels
  4. How is CUDA memory managed?
  5. Modifying registry to increase GPU timeout, windows 7
  6. How can I implement a custom atomic function involving several variables?
  7. Passing Host Function as a function pointer in __global__ OR __device__ function in CUDA
  8. How to verify CuDNN installation?
  9. What is the purpose of using multiple “arch” flags in Nvidia’s NVCC compiler?
  10. How are 2D / 3D CUDA blocks divided into warps?
  11. What is a bank conflict? (Doing Cuda/OpenCL programming)
  12. nvidia-smi Volatile GPU-Utilization explanation?
  13. How do I use Nvidia Multi-process Service (MPS) to run multiple non-MPI CUDA applications?
  14. Any particular function to initialize GPU other than the first cudaMalloc call?
  15. CUDA and nvcc: using the preprocessor to choose between float or double
  16. Copy an object to device?
  17. Polymorphism and derived classes in CUDA / CUDA Thrust
  18. CUDA: How to use -arch and -code and SM vs COMPUTE
  19. How do I select which GPU to run a job on?
  20. device function pointers
  21. How can I make tensorflow run on a GPU with capability 2.x?
  22. cudaMemset() – does it set bytes or integers?
  23. How to implement device side CUDA virtual functions?
  24. How to create a CUDA context?
  25. Inconsistency of IDs between ‘nvidia-smi -L’ and cuDeviceGetName()
  26. CUDA allocation alignment is 256 bytes – seriously?
  27. printf() in my CUDA kernel doesn’t result produce any output
  28. Multiply Rectangular Matrices in CUDA
  29. Which Compute Capability is supported by which CUDA versions?
  30. “invalid configuration argument ” error for the call of CUDA kernel?

Leave a Comment