Speeding Up the Training of Neural Networks with CUDA Technology

• Tweet

• Tweet

Training feed-forward neural networks can take a long time when there is a large amount of data to be used, even when training with more efficient algorithms like Levenberg-Marquardt. Parallel architectures have been a common solution in the area of high performance computing, since the technology used in current processors is reaching the limits of speed. An architecture that has been gaining popularity is the GPGPU (General-Purpose computing on Graphics Processing Units), which has received large investments from companies such as NVIDIA that introduced CUDA (Compute Unified Device Architecture) technology. This paper proposes a faster implementation of neural networks training with Levenberg-Marquardt algorithm using CUDA. The results obtained demonstrate that the whole training time can be almost 30 times shorter than code using Intel Math Library (MKL). A case study for classifying electrical company customers is presented.

Daniel Salles Chevitarese, Dilza Szwarcman and Marley Vellasco. Speeding Up the Training of Neural Networks with CUDA Technology. Artificial Intelligence and Soft Computing. Lecture Notes in Computer Science, Volume 7267/2012, pp 30-38, 2012. [doi: 10.1007/978-3-642-29347-4_4]

Tags: artificial neural networks, CUDA, featured, gpgpu, GPU, HPC, software engineering

Category: Articles, Computer Science