Abstract
The Thick-Restart Lanczos (TRLan) method is an effective method for solving large-scale Hermitian eigenvalue problems. On a modern computer, communication can dominate the solution time of TRLan. To enhance the performance of TRLan, we develop CA-TRLan that integrates communication-avoiding techniques into TRLan. To study the numerical stability and solution time of CA-TRLan, we conduct numerical experiments using both synthetic diagonal matrices and matrices from the University of Florida sparse matrix collection. Our experimental results on up to 1,024 processors of a distributed-memory system demonstrate that CA-TRLan can achieve speedups of up to three over TRLan while maintaining numerical stability.
Chapter PDF
Similar content being viewed by others
References
Bai, Z., Hu, D., Reichel, L.: A Newton basis GMRES implementation. IMA Journal of Numerical Analysis 14, 563–581 (1994)
Carson, E., Knight, N., Demmel, J.: Hypergraph partitioning for computing matrix powers. In: The Proceedings of SIAM Workshop on Combinatorial Scientific Computing (2011)
Demmel, J., Grigori, L., Hoemmen, M., Langou, J.: Communication-optimal parallel and sequential QR and LU factorizations. Technical Report UCB/EECS-2008-89, EECS Department, University of California, Berkeley (2008)
Demmel, J., Hoemmen, M., Mohiyuddin, M., Yelick, K.: Avoiding communication in sparse matrix computations. In: The Proceedings of IEEE International Symposium on Parallel and Distributed Processing (IPDPS), pp. 1–12 (2008)
Hoemmen, M.: Communication-avoiding Krylov subspace methods. PhD thesis, University of California, Berkeley (2010)
Lanczos, C.: An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. J. Res. Nat. Bur. Stand. 45, 255–281 (1950)
Parlett, B.: The symmetric eigenvalue problem. Classics in Applied Mathematics. SIAM, Philadelphia (1998)
Saad, Y.: Numerical Methods for Large Eigenvalue Problems, 2nd edn. Classics in Applied Mathematics. SIAM, Philadelphia (2003)
Stathopoulos, A., Wu, K.: A block orthogonalization procedure with constant synchronization requirements. SIAM J. Sci. Comput. 23, 2165–2182 (2002)
Vuduc, R., Demmel, J., Yelick, K.: OSKI: A library of automatically tuned sparse matrix kernels. In: Proc. SciDAC, J. Physics: Conf. Ser., vol. 16, pp. 521–530 (2005), http://bebop.cs.berkeley.edu/oski/
Wu, K., Simon, H.: Thick-restart Lanczos method for large symmetric eigenvalue problems. SIAM J. Mat. Anal. Appl. 22, 602–616 (2000)
Yamazaki, I., Bai, Z., Simon, H., Wand, L.-W., Wu, K.: Adaptive projection subspace dimension for the thick-restart Lanczos method. ACM Trans. Math. Softw. 37 (2010), https://codeforge.lbl.gov/projects/trlan/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yamazaki, I., Wu, K. (2012). A Communication-Avoiding Thick-Restart Lanczos Method on a Distributed-Memory System. In: Alexander, M., et al. Euro-Par 2011: Parallel Processing Workshops. Euro-Par 2011. Lecture Notes in Computer Science, vol 7155. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29737-3_39
Download citation
DOI: https://doi.org/10.1007/978-3-642-29737-3_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29736-6
Online ISBN: 978-3-642-29737-3
eBook Packages: Computer ScienceComputer Science (R0)