How do I convert an OpenCV image (BGR and BGRA) to a pygame.Surface object

by

The shape attribute of a numpy.array is the number of elements in each dimension. The first element is the height, the second the width and the third the number of channels.
A pygame.Surface can be generated by pygame.image.frombuffer. The 1st argument can be a numpy.array and the 2nd argument is the format (RGB or RGBA).

Get the size (widht, height) for the pygame.Surface object by slicing:

size = cvImage.shape[1::-1]

Determine the target format for the pygame.Surface object, depending on the third channel:

format="RGBA" if cvImage.shape[2] == 4 else 'RGB'

Since the source format is BGR or BGRA, but the target format is RGB or RGBA, the red and blue channels have to be swapped:

cvImage[:, :, [0, 2]] = cvImage[:, :, [2, 0]]

In the case of a grayscale image, the shape of the array must be changed using numpy.reshape and the gray channel must be expanded to a red-green and blue color channel using numpy.repeat:

cvImage = np.repeat(cvImage.reshape(size[1], size[0], 1), 3, axis = 2)

With his data the pygame.Surface object can be generated by pygame.image.frombuffer:

surface = pygame.image.frombuffer(cvImage.flatten(), size, format)

To ensure that the image has the same pixel format as the display Surface and for optimal performance, the Surface should be converted with either convert or convert_alpha:

surface = surface.convert_alpha() if format == 'RGBA' else surface.convert()

Complete function cvImageToSurface:

def c2ImageToSurface(cvImage):
    if cvImage.dtype.name == 'uint16':
        cvImage = (cvImage / 256).astype('uint8')
    size = cvImage.shape[1::-1]
    if len(cvImage.shape) == 2:
        cvImage = np.repeat(cvImage.reshape(size[1], size[0], 1), 3, axis = 2)
        format="RGB"
    else:
        format="RGBA" if cvImage.shape[2] == 4 else 'RGB'
        cvImage[:, :, [0, 2]] = cvImage[:, :, [2, 0]]
    surface = pygame.image.frombuffer(cvImage.flatten(), size, format)
    return surface.convert_alpha() if format == 'RGBA' else surface.convert()

Minimal example:

import os
import pygame
import cv2 as cv
import numpy as np

def cvImageToSurface(cvImage):
    if cvImage.dtype.name == 'uint16':
        cvImage = (cvImage / 256).astype('uint8')
    size = cvImage.shape[1::-1]
    if len(cvImage.shape) == 2:
        cvImage = np.repeat(cvImage.reshape(size[1], size[0], 1), 3, axis = 2)
        format="RGB"
    else:
        format="RGBA" if cvImage.shape[2] == 4 else 'RGB'
        cvImage[:, :, [0, 2]] = cvImage[:, :, [2, 0]]
    surface = pygame.image.frombuffer(cvImage.flatten(), size, format)
    return surface.convert_alpha() if format == 'RGBA' else surface.convert()

pygame.init()
window = pygame.display.set_mode((400, 400))
clock = pygame.time.Clock()

cvImage1 = cv.imread('woodtiles.jpg', cv.IMREAD_GRAYSCALE)
cvImage2 = cv.imread('woodtiles.jpg', cv.IMREAD_UNCHANGED)
cvImage3 = cv.imread('Apple1-256.png', cv.IMREAD_UNCHANGED)
pygameSurface1 = cvImageToSurface(cvImage1)
pygameSurface2 = cvImageToSurface(cvImage2)
pygameSurface3 = cvImageToSurface(cvImage3)

run = True
while run:
    clock.tick(60)
    for event in pygame.event.get():
        if event.type == pygame.QUIT:
            run = False

    window.fill(0)
    window.blit(pygameSurface1, pygameSurface1.get_rect(topleft = window.get_rect().inflate(-10, -10).topleft))
    window.blit(pygameSurface2, pygameSurface2.get_rect(center = window.get_rect().center))
    window.blit(pygameSurface3, pygameSurface3.get_rect(bottomright = window.get_rect().inflate(-10, -10).bottomright))
    pygame.display.flip()

pygame.quit()

More Related Contents:

  1. Convert a 3D array to RGB valued array [closed]
  2. How do I detect collision in pygame?
  3. How can I make the ball move instead of stretch in pygame?
  4. Lag when win.blit() background pygame
  5. Animated sprite from few images
  6. Is there any other way to load a resource like an image, sound, or font into Pygame? [closed]
  7. How can I add new dimensions to a Numpy array?
  8. how to convert an RGB image to numpy array?
  9. How to use `cv2.findContours` in different OpenCV versions?
  10. RuntimeError: module compiled against API version a but this version of numpy is 9
  11. Move Character with Vector
  12. SVG rendering in a PyGame application. Prior to Pygame 2.0, Pygame did not support SVG. Then how did you load it?
  13. Convert RGB to black OR white
  14. Read a base 64 encoded image from memory using OpenCv python library
  15. How can I move the ball instead of leaving a trail all over the screen in pygame?
  16. How to turn the sprite in pygame while moving with the keys
  17. How to draw a chessboard with Pygame and move the pieces on the board?
  18. Screen Capture with OpenCV and Python-2.7
  19. How to zoom in and out of an image pygame and using the mousposition as the center of the zoom
  20. How can I upgrade NumPy?
  21. How do I focus light or how do I only draw certain circular parts of the window in pygame?
  22. Automatic White Balancing with Grayworld assumption
  23. Python, OpenCV: Increasing image brightness without overflowing UINT8 array
  24. C++ conversion from NumPy array to Mat (OpenCV)
  25. Opencv matchTemplate and np.where(): keep only unique values
  26. How do I make the screen ignore the background color of some image?
  27. Determine if an image exists within a larger image, and if so, find it, using Python
  28. Pygame not returning events while embedded in PyQt
  29. How can I drag more than 2 images in PyGame?
  30. cv2.imread: checking if image is being read

Leave a Comment