scholarly journals A q-Gradient Descent Algorithm with Quasi-Fejér Convergence for Unconstrained Optimization Problems

2021 ◽  
Vol 5 (3) ◽  
pp. 110
Author(s):  
Shashi Kant Mishra ◽  
Predrag Rajković ◽  
Mohammad Esmael Samei ◽  
Suvra Kanti Chakraborty ◽  
Bhagwat Ram ◽  
...  

We present an algorithm for solving unconstrained optimization problems based on the q-gradient vector. The main idea used in the algorithm construction is the approximation of the classical gradient by a q-gradient vector. For a convex objective function, the quasi-Fejér convergence of the algorithm is proved. The proposed method does not require the boundedness assumption on any level set. Further, numerical experiments are reported to show the performance of the proposed method.

2020 ◽  
Vol 19 (3) ◽  
pp. 107-115
Author(s):  
Sajjadul Bari ◽  
Md. Rajib Arefin ◽  
Sohana Jahan

This research is focused on Unconstrained Optimization problems. Among a number of methods that can be used to solve Unconstrained Optimization problems we have worked on Gradient and Coordinate Descent methods. Step size plays an important role for optimization. Here we have performed numerical experiment with Gradient and Coordinate Descent method for several step size choices. Comparison between different variants of Gradient and Coordinate Descent methods and their efficiency are demonstrated by implementing in loss functions minimization problem.


2014 ◽  
Vol 8 (1) ◽  
pp. 218-221 ◽  
Author(s):  
Ping Hu ◽  
Zong-yao Wang

We propose a non-monotone line search combination rule for unconstrained optimization problems, the corresponding non-monotone search algorithm is established and its global convergence can be proved. Finally, we use some numerical experiments to illustrate the new combination of non-monotone search algorithm’s effectiveness.


1991 ◽  
Vol 2 (2-3) ◽  
pp. 175-182 ◽  
Author(s):  
D.T. Nguyen ◽  
O.O. Storaasli ◽  
E.A. Carmona ◽  
M. Al-Nasra ◽  
Y. Zhang ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document