"Hello, World!" for a GPU is easier than you might think.
The following steps are all that is required for your first
GPU program. This is for a PC/nVidia/cuda. (I'll post again
when I have it for ARM/Mali/OpenCL.)
lspci | grep -i nvidia # nVidia specific for now
sudo apt-get install nvidia-cuda-toolkit nvidia-cuda-doc nvidia-cuda-dev
nvcc
hello_gpu.cu -o hello -L/usr/lib/x86_64-linux-gnu/ -lcudart
./hello
On my system doing the apt-get caused a fairly large update
since there were quite a few unmet dependencies. If this
demo is of interest to you then you might be interested in
the Udacity class on parallel programming:
https://www.udacity.com/course/cs344
Bob