Development of naturally fault tolerant algorithms for computing on 100,000 processors

This paper describes ongoing research at Oak Ridge National Laboratory into the issues and potential problems of algorithm scalability to 100,000 processor systems. Such massively parallel computers are projected to be needed to reach a petaflops computational speed before 2010. And to make such hypothetical machines a reality, IBM Research has begun developing a computer named "BlueGene" that could have up to 65,536 processor chips in the 2005 time frame. A key issue is how to effectively...