Skip to main navigation menu Skip to main content Skip to site footer

Articles

Vol. 11 (2024)

Remarks on Solving Methods of Nonlinear Equations

DOI
https://doi.org/10.31875/2409-9848.2024.11.1
Submitted
March 7, 2024
Published
2024-03-08

Abstract

Abstract: In the field of mechanical engineering, many practical problems can be converted into nonlinear problems, such as the meshing problem of mechanical transmission. So the solution of nonlinear equations has important theoretical research and practical application significance. Whether the traditional Newton iteration method or the intelligent optimization algorithm after the popularization of computers, both them have been greatly enriched and developed through the continuous in-depth research of scholars at home and abroad, and a series of improved algorithms have emerged. This paper mainly reviews the research status of solving nonlinear equations from two aspects of traditional iterative method and intelligent optimization algorithm, systematically reviews the research achievements of domestic and foreign scholars, and puts forward prospects for future research directions.

References

  1. J.M. Ortega, W.C. Rheinboldt, Jujina (Chinese translation). Iterative Solution of multivariate nonlinear Equations, Beijing: Science Press, 1983.
  2. D. Wang. Solution and Optimization of Nonlinear Equations, Beijing: People's Education Press, 1983.
  3. R. Xie, P. Jiang. Nonlinear Numerical Analysis, Shanghai: Shanghai Jiao Tong University Press, 1984.
  4. D.M. Young, J.F. Traub. Iterative methods for the solution of equations [M]. American Mathematical Monthly, 1967. https://doi.org/10.2307/2316079
  5. M.S. Petkovi', B. Neta, Multipoint methods for solving nonlinear equations [J]. Applied Mathematics and Computation, 2014, 226(1): 635-660. https://doi.org/10.1016/j.amc.2013.10.072
  6. Q. Ni. Optimization Method and Program Design [M]. Wuhan: Science Press, 2009.
  7. G. Feng. Iterative Solution of Nonlinear Equations [M]. Shanghai: Science and Technology Press, 1989.
  8. W.C. Rheinboldt. Methods for solving systems of nonlinear equations [M]. SIAM, 1998. https://doi.org/10.1137/1.9781611970012
  9. J. Moser. Stable and random motions in dynamical systems: With special emphasis on celestial mechanics [M]. Princeton University Press, 1973.
  10. N. Deng et al. Computational methods for Unconstrained Optimization, Beijing: Science Press, 1982.
  11. J. Xu. Mechanical Optimization Design, Beijing: China Machine Press, 1996.
  12. W. Liu. Mechanical Optimization Design (2nd Edition), Beijing: Tsinghua University Press, 1997.
  13. Jorge Nocedal, Stephen J. Wright. Numerical Optimization, Springer Science + Business Media, Inc., 1999. https://doi.org/10.1007/b98874
  14. B. Chen. Optimization Theory and Algorithm, Beijing: Tsinghua University Press, 2000.
  15. Ramon E. Moore, Methods and Application of Interval Analysis, SIAM, Philadelphia, Pennsylvania, 1979.
  16. D. Wang, L. Zhang, Deng Nai-yang, Interval Algorithms for Nonlinear Equations (Computational Mathematics Series), Shanghai: Shanghai Science and Technology Press, 1987.
  17. Q. Li, Z. Mo, L.Qi. Numerical Solution of Nonlinear Equations, Beijing: Science Press, 1999
  18. Editorial Board, Handbook of Modern Applied Mathematics. Handbook of Modern Applied Mathematics: Calculation and Numerical Analysis Volume, Beijing: Tsinghua University Press, 2005.
  19. Z. Wang. A discussion on Homotopy methods, Dalian: Dalian University of Technology Press, 2011.
  20. Y. He, X. Li. Neural Network Control Technology and its Application, Beijing: Science Press, 2000.
  21. X. Wang, L. Cao. Genetic Algorithm Theory, Application and Software Implementation, Xi 'an: Xi 'an Jiaotong University Press, 2004.
  22. M. Gen, R. Cheng, Yu X et al. Genetic Algorithm and Engineering Optimization, Beijing: Tsinghua University Press, 2005.
  23. L. Kang, Y. Xie, Y. You, et al. Nonlinear Numerical Parallel Algorithm Simulated Annealing Algorithm (Volume 1), Beijing: Science Press, 2003.
  24. W. Xing, J. Xie. Modern Optimization Calculation Methods, Beijing: Tsinghua University Press, 2005.
  25. Y. Zhang, D. Gong. Advanced Multi-objective Particle Swarm Optimization Theory and its Application, Beijing: Science Press, 2016.
  26. R. Horst, P. M. Pardalos, N. V. Thoai, Yellow and Red Selection (Chinese translation). Introduction to Global Optimization, Beijing: Tsinghua University Press, 2005.
  27. Broyden C G. A class of methods for solving nonlinear simultaneous equations [J]. Mathematics of Computation, 1965, 12 (92): 577-593. https://doi.org/10.1090/S0025-5718-1965-0198670-6
  28. R.S. Dembo, S.C. Eisenstat, T. Steihaug. The Inexact Newton methods [J]. Journal of SIAM Journal on Numerical Analysis, 1982, 12 (2): 400-408. https://doi.org/10.1137/0719025
  29. S.C. Eisenstat, H.F. Watker. Globally convergent inexact Newton methods [J]. SIAM Journal on Optimization, 1994, 4 (2): 393-422. https://doi.org/10.1137/0804022
  30. P.N. Brawn, Y. Saad. Hybrid Krylov methods for nonlinear systems of equations [J]. SIAM Journal on Scientific and Statistical Computing, 1990,11(3): 450-481. https://doi.org/10.1137/0911026
  31. P.N. Brawn, Y.Saad. Convergence theory of nonlinear Newton-Krylov algorithms [J]. SIAM Journal on Optimization, 1994, 4 (2): 297-330. https://doi.org/10.1137/0804017
  32. Z.Z. Bai, G.H. Golub, M.K. Ng. Hermitian and skew-Hermitian splitting methods for non-Hermitian positive definite linear [J]. SIAM Journal on Matrix Analysis and Applications, 2003,24: 603-626. https://doi.org/10.1137/S0895479801395458
  33. Z.Z. Bai, X.P. Guo. On Newton-HSS methods for systems of nonlinear equations with positive definite Jacobian matrices [J]. Journal of computational mathematics, 2010, 28(2): 235-260. https://doi.org/10.4208/jcm.2009.10-m2836
  34. Y. Cao, W.W. Tan, M.Q. Jiang. A generalization of the positive-definite and skew-Hermitian splitting Numerical Algebra Control and Optimization, 2012, 2(4): 811-821. https://doi.org/10.3934/naco.2012.2.811
  35. M. Benzi, D. Bertaccini. A generalization of Hermitian and skew-Hermitian splitting iteration [J]. SIAM Journal on Matrix Analysis and Applications, 2009,31(2): 360-374. https://doi.org/10.1137/080723181
  36. A. Yang, Y. Wu, X. Li, L. Meng. Newton-PSS iterative method for a Class of nonlinear equations [J]. Computational Mathematics, 2014, 4: 3-14.
  37. LI X. Research on HSS based iterative method and acceleration technique for several linear and nonlinear equations and a class of continuous Sylverster equations [D]. PhD Thesis, Lanzhou University, 2013.
  38. Q.B. Wu, M.H. Chen. Convergence analysis of modified Newton-HSS methods for systems of nonlinear equations [J]. Numerical Algorithms, 2013: 659-683. https://doi.org/10.1007/s11075-012-9684-5
  39. M.T. Darvishi, A. Barati. A thrid-order Newton-type method to solve systems of nonlinear equations [J].Applied Mathematics and Computation, 2007, 187: 630-635. https://doi.org/10.1016/j.amc.2006.08.080
  40. P.F. Dai, Q.B. Wu, M.H.Chen. Modified Newton-NSS method for solving systems of nonlinear equations [J]. Numerical Algorithms, 2018, 77: 1-21. https://doi.org/10.1007/s11075-017-0301-5
  41. P.F. Dai, Q.B. Wu, Y.X. Wu, W.L. Liu. Modified Newton-PSS method to solve nonlinear equations [J]. Applied Mathematics Letters, 2018, 86: 305-312. https://doi.org/10.1016/j.aml.2018.07.004
  42. Y. Li, Guo. Y. Multi-step modified Newton-HSS methods for systems of nonlinear equations with positive definite Jacobian matrices [J]. Numerical Algorithms, 2017, 75: 55-80. https://doi.org/10.1007/s11075-016-0196-6
  43. Sui Yunkang, Ye B. A convenient and practical rational approximation and its improvement on a large number of optimization methods [J]. Journal of Operations Research, 1993, 12(1): 52-66.
  44. Sui Y, Sa Heya, Chen Guoqing. Improvement of Rational approximation RALND for cumulative two-point information [J]. Computational Mathematics, 2014, 36(1): 51-64.
  45. Sui Y, Yang Z. Improved Newton Method and Dual Method using two-point rational approximation [J]. Journal of Dalian University of Technology, 1994, 12(1): 2-9.
  46. H.Y. Sa, G.Q. Chen, Y.k. Sui, C.Y. Wu. A new Newton-like method for solving nonlinear Equations [J]. SpringerPlus, 2016, 5 (1): 1269. https://doi.org/10.1186/s40064-016-2909-7
  47. Gao W, Luo Y. Review of intelligent optimization algorithms for solving nonlinear equations [J]. Control and Decision, 2019, 36(4): 769-778.
  48. Grosan C, Abraham A. A new approach for solving nonlinear equations systems [J]. IEEE Transactions on Systems, Man and Cybernetics-Part A, 2008, 38(3): 698-724. https://doi.org/10.1109/TSMCA.2008.918599
  49. Song W, Wang Y, Li H X, et al. Locating multiple optimal solutions of nonlinear equation systems based on multiobjective IEEE Transactions on Evolutionary Computation, 2015, 19(3): 414-431. https://doi.org/10.1109/TEVC.2014.2336865
  50. Gong W Y, Wang Y, Cai Z H. A weighted biobjective transformation technique for locating multiple optimal solutions of nonlinear equation systems[J]. IEEE Transactions on Evolutionary Computation, 2017, 21(5): 697-713. https://doi.org/10.1109/TEVC.2017.2670779
  51. Gong W Y, Wang Y, Cai Z H. Finding multiple roots of nonlinear equation systems via a repulsion-based adaptive differential evolution [J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 50(4): 1499-1513
  52. https://doi.org/10.1109/TSMC.2018.2828018
  53. Pourjafari E, Mojallali H. Solving nonlinear equations systems with a new approach based on invasive weed optimization algorithm and clustering [J]. Swarm and Evolutionary Computation, 2012, 4: 33-43. https://doi.org/10.1016/j.swevo.2011.12.001
  54. Ramadas G C, Fernandes E M, Rocha A A. Multiple roots of systems of equations by repulsion merit functions [J]. Computational Science and Its Applications, 2014(2): 126-139. https://doi.org/10.1007/978-3-319-09129-7_10
  55. Hirsch M J, Pardalos P M, Resende M G C. Solving systems of nonlinear equations with continuous GRASP [J]. Nonlinear Analysis: Real World Applications, 2009, 10(4): 2000-2006. https://doi.org/10.1016/j.nonrwa.2008.03.006
  56. Storn R, Price K. Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 1997, 11(4): 341-359. https://doi.org/10.1023/A:1008202821328
  57. Liao Z W, Gong W Y, Yan X S. Solving nonlinear equations system with dynamic repulsion-based evolutionary Algorithms [J]. IEEE the Transactions on Systems, Man, and Cybernetics, Systems, 2020, 50 (4): 1590-1601. https://doi.org/10.1109/TSMC.2018.2852798
  58. Tsoulos I G, Stavrakoudis A. On locating all roots of systems of nonlinear equations inside bounded domain using global optimization methods [J]. Nonlinear Analysis: Real World Application, 2010,11(4): 2465-2471. https://doi.org/10.1016/j.nonrwa.2009.08.003
  59. Sacco W F, Henderson N. Finding all solutions of nonlinear systems using a hybrid metaheuristic with fuzzy clustering means [J]. Applied Soft Computing, 2011, 11(8): 5424-5432. https://doi.org/10.1016/j.asoc.2011.05.016
  60. He W, Gong W Y, Wang L, et al. Fuzzy neighborhood based differential evolution with orientation for nonlinear equation system [J]. Knowledge-Based Systems, 2019, 182: 104796. https://doi.org/10.1016/j.knosys.2019.06.004
  61. Liao Z, Gong W, A decomposition based differential evolution with reinitialization for nonlinear equations systems [J]. Knowledge-Based Systems, 2019, 191: 105312. https://doi.org/10.1016/j.knosys.2019.105312
  62. Zhang Q F, Li H. A multi-objective evolutionary algorithm based on decomposition [J]. IEEE Transactions on Evolutionary Computation, 2007, 11(6): 712-731. https://doi.org/10.1109/TEVC.2007.892759
  63. Gao W F, Li G H, Zhang Q F, Solving nonlinear equation systems by a two-phase evolutionary algorithm [J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2019: 1-12.
  64. Mhetre P S. Genetic algorithm for linear and nonlinear equation [J]. International Journal of Advanced Engineering Technology, 2012(2): 114-118.
  65. Zhou L, Jiang C S. New method for solving nonlinear equation systems [J]. Journal of Chinese Conputer Systems, 2008, 29(9): 1709-1713.
  66. Kennedy J, Eberhart R C. Particle swarm optimization [C]. Proceedings of the 1995 IEEE International Conference on Neural Networks. Perth.
  67. Wang J. Immune genetic algorithm for solving nonlinear equation[C]. Proceedings of the 2011 International Conference on Mechatronic Science, Electric Engineering and Computer. Jilin, 2011: 2094-2097.
  68. Brits R, Engelbrecht A P. Solving systems of unconstrained equations using particle swarm optimization[C]. Proceedings of the 2002 IEEE International Conference Systems, Man and Cybernetics. Yasmine Hammamet, 2002: 6-9.
  69. Oliveira H, Petraglia A. Solving nonlinear systems of functional equations with fuzzy adaptive simulated annealing [J]. Applied Soft Computing, 2013, 13(11): 4349-4357. https://doi.org/10.1016/j.asoc.2013.06.018
  70. Henderson N, Sacco W F, Platt G M. Finding more than one root of nonlinear equations via a polarization technique: An application to double retrograde vaporization [J]. Chemical Engineering Research& Design, 2010, 88(5): 551-561. https://doi.org/10.1016/j.cherd.2009.11.001
  71. L. Yong. Research progress of Newton iteration method for nonlinear equations [J]. Mathematics in Practice and Understanding, 2021, (15).
  72. Cruz W, Raydan M, Nonmonotone speetral methods for large-seale nonlinear systems. Optimization Methodsand Software 18 2003 (5): 583-559. https://doi.org/10.1080/10556780310001610493