The GPUArray Array Class

class pycuda.gpuarray.GPUArray(shape, dtype, allocator=None)

A numpy.ndarray work-alike that stores its data and performs its computations on the compute device. shape and dtype work exactly as in numpy. Arithmetic methods in GPUArray support the broadcasting of scalars. (e.g. array+5) If the

allocator is a callable that, upon being called with an argument of the number of bytes to be allocated, returns an object that can be cast to an int representing the address of the newly allocated memory. Observe that both pycuda.driver.mem_alloc() and pycuda.tools.DeviceMemoryPool.alloc() are a model of this interface.

gpudata
The pycuda.driver.DeviceAllocation instance created for the memory that backs this GPUArray.
shape
The tuple of lengths of each dimension in the array.
dtype
The numpy.dtype of the items in the GPU array.
size
The number of meaningful entries in the array. Can also be computed by multiplying up the numbers in shape.
mem_size
The total number of entries, including padding, that are present in the array. Padding may arise for example because of pitch adjustment by pycuda.driver.mem_alloc_pitch().
nbytes
The size of the entire array in bytes. Computed as size times dtype.itemsize.
__len__()

Returns the size of the leading dimension of self.

Warning

This method existed in version 0.93 and below, but it returned the value of size instead of its current value. The change was made in order to match numpy.

set(ary)

Transfer the contents the numpy.ndarray object ary onto the device.

ary must have the same dtype and size (not necessarily shape) as self.

set_async(ary, stream=None)

Asynchronously transfer the contents the numpy.ndarray object ary onto the device, optionally sequenced on stream.

ary must have the same dtype and size (not necessarily shape) as self.

get(ary=None, stream=None, pagelocked=False)
Transfer the contents of self into ary or a newly allocated numpy.ndarray. If ary is given, it must have the right size (not necessarily shape) and dtype. If it is not given, a pagelocked specifies whether the new array is allocated page-locked.
get_async(ary=None, stream=None)
Transfer the contents of self into ary or a newly allocated numpy.ndarray. If ary is given, it must have the right size (not necessarily shape) and dtype. If it is not given, a page-locked* array is newly allocated.
mul_add(self, selffac, other, otherfac, add_timer=None, stream=None):
Return selffac*self + otherfac*other. add_timer, if given, is invoked with the result from pycuda.driver.Function.prepared_timed_call().
__add__(other)
__sub__(other)
__iadd__(other)
__isub__(other)
__neg__(other)
__mul__(other)
__div__(other)
__rdiv__(other)
__pow__(other)
__abs__()
Return a GPUArray containing the absolute value of each element of self.
fill(scalar, stream=None)
Fill the array with scalar.
bind_to_texref(texref, allow_offset=False)

Bind self to the pycuda.driver.TextureReference texref.

Due to alignment requirements, the effective texture bind address may be different from the requested one by an offset. This method returns this offset in units of self‘s data type. If allow_offset is False, a nonzero value of this offset will cause an exception to be raised.

Note

It is recommended to use bind_to_texref_ext() instead of this method.

bind_to_texref_ext(texref, channels=1, allow_offset=False)

Bind self to the pycuda.driver.TextureReference texref. In addition, set the texture reference’s format to match dtype and its channel count to channels. This routine also sets the texture reference’s pycuda.driver.TRSF_READ_AS_INTEGER flag, if necessary.

Due to alignment requirements, the effective texture bind address may be different from the requested one by an offset. This method returns this offset in units of self‘s data type. If allow_offset is False, a nonzero value of this offset will cause an exception to be raised.

(Added in version 0.93.)

Constructing GPUArray Instances

pycuda.gpuarray.to_gpu(ary, allocator=None)

Return a GPUArray that is an exact copy of the numpy.ndarray instance ary.

See GPUArray for the meaning of allocator.

pycuda.gpuarray.to_gpu_async(ary, allocator=None, stream=None)

Return a GPUArray that is an exact copy of the numpy.ndarray instance ary. The copy is done asynchronously, optionally sequenced into stream.

See GPUArray for the meaning of allocator.

pycuda.gpuarray.empty(shape, dtype)
A synonym for the GPUArray constructor.
pycuda.gpuarray.zeros(shape, dtype)
Same as empty(), but the GPUArray is zero-initialized before being returned.
pycuda.gpuarray.empty_like(other_ary)
Make a new, uninitialized GPUArray having the same properties as other_ary.
pycuda.gpuarray.zeros_like(other_ary)
Make a new, zero-initialized GPUArray having the same properties as other_ary.
pycuda.gpuarray.arange(start, stop, step, dtype=None, stream=None)

Create a GPUArray filled with numbers spaced step apart, starting from start and ending at stop.

For floating point arguments, the length of the result is ceil((stop - start)/step). This rule may result in the last element of the result being greater than stop.

dtype, if not specified, is taken as the largest common type of start, stop and step.

pycuda.gpuarray.take(a, indices, stream=None)
Return the GPUArray [a[indices[0]], ..., a[indices[n]]]. For the moment, a must be a type that can be bound to a texture.
pycuda.gpuarray.sum(a, dtype=None, stream=None)
pycuda.gpuarray.dot(a, b, dtype=None, stream=None)
pycuda.gpuarray.subset_dot(subset, a, b, dtype=None, stream=None)

Elementwise Functions on GPUArrray Instances

The pycuda.cumath module contains elementwise workalikes for the functions contained in math.

Rounding and Absolute Value

pycuda.cumath.fabs(array)
pycuda.cumath.ceil(array)
pycuda.cumath.floor(array)

Exponentials, Logarithms and Roots

pycuda.cumath.exp(array)
pycuda.cumath.log(array)
pycuda.cumath.log10(array)
pycuda.cumath.sqrt(array)

Trigonometric Functions

pycuda.cumath.sin(array)
pycuda.cumath.cos(array)
pycuda.cumath.tan(array)
pycuda.cumath.asin(array)
pycuda.cumath.acos(array)
pycuda.cumath.atan(array)

Hyperbolic Functions

pycuda.cumath.sinh(array)
pycuda.cumath.cosh(array)
pycuda.cumath.tanh(array)

Floating Point Decomposition and Assembly

pycuda.cumath.fmod(arg, mod)
Return the floating point remainder of the division arg/mod, for each element in arg and mod.
pycuda.cumath.frexp(arg)
Return a tuple (significands, exponents) such that arg == significand * 2**exponent.
pycuda.cumath.ldexp(significand, exponent)
Return a new array of floating point values composed from the entries of significand and exponent, paired together as result = significand * 2**exponent.
pycuda.cumath.modf(arg)
Return a tuple (fracpart, intpart) of arrays containing the integer and fractional parts of arg.

Generating Arrays of Random Numbers

pycuda.curandom.rand(shape, dtype=numpy.float32, stream=None)
Return an array of shape filled with random values of dtype in the range [0,1).

Single-pass Expression Evaluation

Warning

The following functionality is included in this documentation in the hope that it may be useful, but its interface may change in future revisions. Feedback is welcome.

Evaluating involved expressions on GPUArray instances can be somewhat inefficient, because a new temporary is created for each intermediate result. The functionality in the module pycuda.elementwise contains tools to help generate kernels that evaluate multi-stage expressions on one or several operands in a single pass.

class pycuda.elementwise.ElementwiseKernel(arguments, operation, name="kernel", keep=False, options=[])

Generate a kernel that takes a number of scalar or vector arguments and performs the scalar operation on each entry of its arguments, if that argument is a vector.

arguments is specified as a string formatted as a C argument list. operation is specified as a C assignment statement, without a semicolon. Vectors in operation should be indexed by the variable i.

name specifies the name as which the kernel is compiled, keep and options are passed unmodified to pycuda.driver.SourceModule.

__call__(*args)
Invoke the generated scalar kernel. The arguments may either be scalars or GPUArray instances.

Here’s a usage example:

import pycuda.gpuarray as gpuarray
import pycuda.driver as cuda
import pycuda.autoinit
import numpy
from pycuda.curandom import rand as curand

a_gpu = curand((50,))
b_gpu = curand((50,))

from pycuda.elementwise import ElementwiseKernel
lin_comb = ElementwiseKernel(
        "float a, float *x, float b, float *y, float *z",
        "z[i] = a*x[i] + b*y[i]",
        "linear_combination")

c_gpu = gpuarray.empty_like(a_gpu)
lin_comb(5, a_gpu, 6, b_gpu, c_gpu)

import numpy.linalg as la
assert la.norm((c_gpu - (5*a_gpu+6*b_gpu)).get()) < 1e-5

(You can find this example as examples/demo_elementwise.py in the PyCuda distribution.)

Reductions

class pycuda.reduction.ReductionKernel(dtype_out, neutral, reduce_expr, map_expr=None, arguments=None, name="reduce_kernel", keep=False, options=[])

Here’s a usage example:

a = gpuarray.arange(400, dtype=numpy.float32)
b = gpuarray.arange(400, dtype=numpy.float32)

krnl = ReductionKernel(numpy.float32, neutral="0",
        reduce_expr="a+b", map_expr="a[i]*b[i]",
        arguments="float *a, float *b")

my_dot_prod = krnl(a, b).get()