On optimal tree traversals for sparse matrix factorization

Abstract : We study the complexity of traversing tree-shaped workflows whose tasks require large I/O files. Such workflows typically arise in the multifrontal method of sparse matrix factorization. We target a classical two-level memory system, where the main memory is faster but smaller than the secondary memory. A task in the workflow can be processed if all its predecessors have been processed, and if its input and output files fit in the currently available main memory. The amount of available memory at a given time depends upon the ordering in which the tasks are executed. What is the minimum amount of main memory, over all postorder schemes, or over all possible traversals, that is needed for an in-core execution? We establish several complexity results that answer these questions. We propose a new, polynomial time, exact algorithm which runs faster than a reference algorithm. Next, we address the setting where the required memory renders a pure in-core solution unfeasible. In this setting, we ask the following question: what is the minimum amount of I/O that must be performed between the main memory and the secondary memory? We show that this latter problem is NP-hard, and propose efficient heuristics. All algorithms and heuristics are thoroughly evaluated on assembly trees arising in the context of sparse matrix factorizations.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

https://hal-ens-lyon.archives-ouvertes.fr/ensl-00527462
Contributor : Mathias Jacquelin <>
Submitted on : Tuesday, October 19, 2010 - 1:00:37 PM
Last modification on : Sunday, September 29, 2019 - 9:58:17 PM
Long-term archiving on: Friday, October 26, 2012 - 11:40:51 AM

File

rr_io_complexity_on_trees.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : ensl-00527462, version 1

Collections

Citation

Mathias Jacquelin, Loris Marchal, Yves Robert, Bora Uçar. On optimal tree traversals for sparse matrix factorization. 2010. ⟨ensl-00527462v1⟩

Share

Metrics

Record views

112

Files downloads

117