Skip to main navigation menu Skip to main content Skip to site footer


Vol. 11 (2024)

Remarks on Solving Methods of Nonlinear Equations

March 7, 2024


Abstract: In the field of mechanical engineering, many practical problems can be converted into nonlinear problems, such as the meshing problem of mechanical transmission. So the solution of nonlinear equations has important theoretical research and practical application significance. Whether the traditional Newton iteration method or the intelligent optimization algorithm after the popularization of computers, both them have been greatly enriched and developed through the continuous in-depth research of scholars at home and abroad, and a series of improved algorithms have emerged. This paper mainly reviews the research status of solving nonlinear equations from two aspects of traditional iterative method and intelligent optimization algorithm, systematically reviews the research achievements of domestic and foreign scholars, and puts forward prospects for future research directions.


  1. J.M. Ortega, W.C. Rheinboldt, Jujina (Chinese translation). Iterative Solution of multivariate nonlinear Equations, Beijing: Science Press, 1983.
  2. D. Wang. Solution and Optimization of Nonlinear Equations, Beijing: People's Education Press, 1983.
  3. R. Xie, P. Jiang. Nonlinear Numerical Analysis, Shanghai: Shanghai Jiao Tong University Press, 1984.
  4. D.M. Young, J.F. Traub. Iterative methods for the solution of equations [M]. American Mathematical Monthly, 1967.
  5. M.S. Petkovi', B. Neta, Multipoint methods for solving nonlinear equations [J]. Applied Mathematics and Computation, 2014, 226(1): 635-660.
  6. Q. Ni. Optimization Method and Program Design [M]. Wuhan: Science Press, 2009.
  7. G. Feng. Iterative Solution of Nonlinear Equations [M]. Shanghai: Science and Technology Press, 1989.
  8. W.C. Rheinboldt. Methods for solving systems of nonlinear equations [M]. SIAM, 1998.
  9. J. Moser. Stable and random motions in dynamical systems: With special emphasis on celestial mechanics [M]. Princeton University Press, 1973.
  10. N. Deng et al. Computational methods for Unconstrained Optimization, Beijing: Science Press, 1982.
  11. J. Xu. Mechanical Optimization Design, Beijing: China Machine Press, 1996.
  12. W. Liu. Mechanical Optimization Design (2nd Edition), Beijing: Tsinghua University Press, 1997.
  13. Jorge Nocedal, Stephen J. Wright. Numerical Optimization, Springer Science + Business Media, Inc., 1999.
  14. B. Chen. Optimization Theory and Algorithm, Beijing: Tsinghua University Press, 2000.
  15. Ramon E. Moore, Methods and Application of Interval Analysis, SIAM, Philadelphia, Pennsylvania, 1979.
  16. D. Wang, L. Zhang, Deng Nai-yang, Interval Algorithms for Nonlinear Equations (Computational Mathematics Series), Shanghai: Shanghai Science and Technology Press, 1987.
  17. Q. Li, Z. Mo, L.Qi. Numerical Solution of Nonlinear Equations, Beijing: Science Press, 1999
  18. Editorial Board, Handbook of Modern Applied Mathematics. Handbook of Modern Applied Mathematics: Calculation and Numerical Analysis Volume, Beijing: Tsinghua University Press, 2005.
  19. Z. Wang. A discussion on Homotopy methods, Dalian: Dalian University of Technology Press, 2011.
  20. Y. He, X. Li. Neural Network Control Technology and its Application, Beijing: Science Press, 2000.
  21. X. Wang, L. Cao. Genetic Algorithm Theory, Application and Software Implementation, Xi 'an: Xi 'an Jiaotong University Press, 2004.
  22. M. Gen, R. Cheng, Yu X et al. Genetic Algorithm and Engineering Optimization, Beijing: Tsinghua University Press, 2005.
  23. L. Kang, Y. Xie, Y. You, et al. Nonlinear Numerical Parallel Algorithm Simulated Annealing Algorithm (Volume 1), Beijing: Science Press, 2003.
  24. W. Xing, J. Xie. Modern Optimization Calculation Methods, Beijing: Tsinghua University Press, 2005.
  25. Y. Zhang, D. Gong. Advanced Multi-objective Particle Swarm Optimization Theory and its Application, Beijing: Science Press, 2016.
  26. R. Horst, P. M. Pardalos, N. V. Thoai, Yellow and Red Selection (Chinese translation). Introduction to Global Optimization, Beijing: Tsinghua University Press, 2005.
  27. Broyden C G. A class of methods for solving nonlinear simultaneous equations [J]. Mathematics of Computation, 1965, 12 (92): 577-593.
  28. R.S. Dembo, S.C. Eisenstat, T. Steihaug. The Inexact Newton methods [J]. Journal of SIAM Journal on Numerical Analysis, 1982, 12 (2): 400-408.
  29. S.C. Eisenstat, H.F. Watker. Globally convergent inexact Newton methods [J]. SIAM Journal on Optimization, 1994, 4 (2): 393-422.
  30. P.N. Brawn, Y. Saad. Hybrid Krylov methods for nonlinear systems of equations [J]. SIAM Journal on Scientific and Statistical Computing, 1990,11(3): 450-481.
  31. P.N. Brawn, Y.Saad. Convergence theory of nonlinear Newton-Krylov algorithms [J]. SIAM Journal on Optimization, 1994, 4 (2): 297-330.
  32. Z.Z. Bai, G.H. Golub, M.K. Ng. Hermitian and skew-Hermitian splitting methods for non-Hermitian positive definite linear [J]. SIAM Journal on Matrix Analysis and Applications, 2003,24: 603-626.
  33. Z.Z. Bai, X.P. Guo. On Newton-HSS methods for systems of nonlinear equations with positive definite Jacobian matrices [J]. Journal of computational mathematics, 2010, 28(2): 235-260.
  34. Y. Cao, W.W. Tan, M.Q. Jiang. A generalization of the positive-definite and skew-Hermitian splitting Numerical Algebra Control and Optimization, 2012, 2(4): 811-821.
  35. M. Benzi, D. Bertaccini. A generalization of Hermitian and skew-Hermitian splitting iteration [J]. SIAM Journal on Matrix Analysis and Applications, 2009,31(2): 360-374.
  36. A. Yang, Y. Wu, X. Li, L. Meng. Newton-PSS iterative method for a Class of nonlinear equations [J]. Computational Mathematics, 2014, 4: 3-14.
  37. LI X. Research on HSS based iterative method and acceleration technique for several linear and nonlinear equations and a class of continuous Sylverster equations [D]. PhD Thesis, Lanzhou University, 2013.
  38. Q.B. Wu, M.H. Chen. Convergence analysis of modified Newton-HSS methods for systems of nonlinear equations [J]. Numerical Algorithms, 2013: 659-683.
  39. M.T. Darvishi, A. Barati. A thrid-order Newton-type method to solve systems of nonlinear equations [J].Applied Mathematics and Computation, 2007, 187: 630-635.
  40. P.F. Dai, Q.B. Wu, M.H.Chen. Modified Newton-NSS method for solving systems of nonlinear equations [J]. Numerical Algorithms, 2018, 77: 1-21.
  41. P.F. Dai, Q.B. Wu, Y.X. Wu, W.L. Liu. Modified Newton-PSS method to solve nonlinear equations [J]. Applied Mathematics Letters, 2018, 86: 305-312.
  42. Y. Li, Guo. Y. Multi-step modified Newton-HSS methods for systems of nonlinear equations with positive definite Jacobian matrices [J]. Numerical Algorithms, 2017, 75: 55-80.
  43. Sui Yunkang, Ye B. A convenient and practical rational approximation and its improvement on a large number of optimization methods [J]. Journal of Operations Research, 1993, 12(1): 52-66.
  44. Sui Y, Sa Heya, Chen Guoqing. Improvement of Rational approximation RALND for cumulative two-point information [J]. Computational Mathematics, 2014, 36(1): 51-64.
  45. Sui Y, Yang Z. Improved Newton Method and Dual Method using two-point rational approximation [J]. Journal of Dalian University of Technology, 1994, 12(1): 2-9.
  46. H.Y. Sa, G.Q. Chen, Y.k. Sui, C.Y. Wu. A new Newton-like method for solving nonlinear Equations [J]. SpringerPlus, 2016, 5 (1): 1269.
  47. Gao W, Luo Y. Review of intelligent optimization algorithms for solving nonlinear equations [J]. Control and Decision, 2019, 36(4): 769-778.
  48. Grosan C, Abraham A. A new approach for solving nonlinear equations systems [J]. IEEE Transactions on Systems, Man and Cybernetics-Part A, 2008, 38(3): 698-724.
  49. Song W, Wang Y, Li H X, et al. Locating multiple optimal solutions of nonlinear equation systems based on multiobjective IEEE Transactions on Evolutionary Computation, 2015, 19(3): 414-431.
  50. Gong W Y, Wang Y, Cai Z H. A weighted biobjective transformation technique for locating multiple optimal solutions of nonlinear equation systems[J]. IEEE Transactions on Evolutionary Computation, 2017, 21(5): 697-713.
  51. Gong W Y, Wang Y, Cai Z H. Finding multiple roots of nonlinear equation systems via a repulsion-based adaptive differential evolution [J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 50(4): 1499-1513
  53. Pourjafari E, Mojallali H. Solving nonlinear equations systems with a new approach based on invasive weed optimization algorithm and clustering [J]. Swarm and Evolutionary Computation, 2012, 4: 33-43.
  54. Ramadas G C, Fernandes E M, Rocha A A. Multiple roots of systems of equations by repulsion merit functions [J]. Computational Science and Its Applications, 2014(2): 126-139.
  55. Hirsch M J, Pardalos P M, Resende M G C. Solving systems of nonlinear equations with continuous GRASP [J]. Nonlinear Analysis: Real World Applications, 2009, 10(4): 2000-2006.
  56. Storn R, Price K. Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 1997, 11(4): 341-359.
  57. Liao Z W, Gong W Y, Yan X S. Solving nonlinear equations system with dynamic repulsion-based evolutionary Algorithms [J]. IEEE the Transactions on Systems, Man, and Cybernetics, Systems, 2020, 50 (4): 1590-1601.
  58. Tsoulos I G, Stavrakoudis A. On locating all roots of systems of nonlinear equations inside bounded domain using global optimization methods [J]. Nonlinear Analysis: Real World Application, 2010,11(4): 2465-2471.
  59. Sacco W F, Henderson N. Finding all solutions of nonlinear systems using a hybrid metaheuristic with fuzzy clustering means [J]. Applied Soft Computing, 2011, 11(8): 5424-5432.
  60. He W, Gong W Y, Wang L, et al. Fuzzy neighborhood based differential evolution with orientation for nonlinear equation system [J]. Knowledge-Based Systems, 2019, 182: 104796.
  61. Liao Z, Gong W, A decomposition based differential evolution with reinitialization for nonlinear equations systems [J]. Knowledge-Based Systems, 2019, 191: 105312.
  62. Zhang Q F, Li H. A multi-objective evolutionary algorithm based on decomposition [J]. IEEE Transactions on Evolutionary Computation, 2007, 11(6): 712-731.
  63. Gao W F, Li G H, Zhang Q F, Solving nonlinear equation systems by a two-phase evolutionary algorithm [J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2019: 1-12.
  64. Mhetre P S. Genetic algorithm for linear and nonlinear equation [J]. International Journal of Advanced Engineering Technology, 2012(2): 114-118.
  65. Zhou L, Jiang C S. New method for solving nonlinear equation systems [J]. Journal of Chinese Conputer Systems, 2008, 29(9): 1709-1713.
  66. Kennedy J, Eberhart R C. Particle swarm optimization [C]. Proceedings of the 1995 IEEE International Conference on Neural Networks. Perth.
  67. Wang J. Immune genetic algorithm for solving nonlinear equation[C]. Proceedings of the 2011 International Conference on Mechatronic Science, Electric Engineering and Computer. Jilin, 2011: 2094-2097.
  68. Brits R, Engelbrecht A P. Solving systems of unconstrained equations using particle swarm optimization[C]. Proceedings of the 2002 IEEE International Conference Systems, Man and Cybernetics. Yasmine Hammamet, 2002: 6-9.
  69. Oliveira H, Petraglia A. Solving nonlinear systems of functional equations with fuzzy adaptive simulated annealing [J]. Applied Soft Computing, 2013, 13(11): 4349-4357.
  70. Henderson N, Sacco W F, Platt G M. Finding more than one root of nonlinear equations via a polarization technique: An application to double retrograde vaporization [J]. Chemical Engineering Research& Design, 2010, 88(5): 551-561.
  71. L. Yong. Research progress of Newton iteration method for nonlinear equations [J]. Mathematics in Practice and Understanding, 2021, (15).
  72. Cruz W, Raydan M, Nonmonotone speetral methods for large-seale nonlinear systems. Optimization Methodsand Software 18 2003 (5): 583-559.