A modified Adam algorithm for deep neural network optimization

CC BY

Saved in:
Bibliographic Details
Main Authors: Mohamed, Reyad, Amany M., Sarhan, M., Arafa
Format: Book
Language:English
Published: Springer 2023
Subjects:
Online Access:https://link.springer.com/article/10.1007/s00521-023-08568-z
https://dlib.phenikaa-uni.edu.vn/handle/PNK/8343
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:localhost:PNK-8343
record_format dspace
spelling oai:localhost:PNK-83432023-04-27T01:47:28Z A modified Adam algorithm for deep neural network optimization Mohamed, Reyad Amany M., Sarhan M., Arafa DNNs HN Adam CC BY Deep Neural Networks (DNNs) are widely regarded as the most effective learning tool for dealing with large datasets, and they have been successfully used in thousands of applications in a variety of fields. Based on these large datasets, they are trained to learn the relationships between various variables. The adaptive moment estimation (Adam) algorithm, a highly efficient adaptive optimization algorithm, is widely used as a learning algorithm in various fields for training DNN models. However, it needs to improve its generalization performance, especially when training with large-scale datasets. Therefore, in this paper, we propose HN Adam, a modified version of the Adam Algorithm, to improve its accuracy and convergence speed. The HN_Adam algorithm is modified by automatically adjusting the step size of the parameter updates over the training epochs. 2023-04-27T01:47:28Z 2023-04-27T01:47:28Z 2023 Book https://link.springer.com/article/10.1007/s00521-023-08568-z https://dlib.phenikaa-uni.edu.vn/handle/PNK/8343 en application/pdf Springer
institution Digital Phenikaa
collection Digital Phenikaa
language English
topic DNNs
HN Adam
spellingShingle DNNs
HN Adam
Mohamed, Reyad
Amany M., Sarhan
M., Arafa
A modified Adam algorithm for deep neural network optimization
description CC BY
format Book
author Mohamed, Reyad
Amany M., Sarhan
M., Arafa
author_facet Mohamed, Reyad
Amany M., Sarhan
M., Arafa
author_sort Mohamed, Reyad
title A modified Adam algorithm for deep neural network optimization
title_short A modified Adam algorithm for deep neural network optimization
title_full A modified Adam algorithm for deep neural network optimization
title_fullStr A modified Adam algorithm for deep neural network optimization
title_full_unstemmed A modified Adam algorithm for deep neural network optimization
title_sort modified adam algorithm for deep neural network optimization
publisher Springer
publishDate 2023
url https://link.springer.com/article/10.1007/s00521-023-08568-z
https://dlib.phenikaa-uni.edu.vn/handle/PNK/8343
_version_ 1764358630082084864
score 8.887836