Re: Webservers with Terrabytes of Data in - recomended setups

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
From: Jacob Yocom-Piatt
Date: Friday, April 20, 2007 - 7:03 am

Joachim Schipper wrote:

at HPC facilities (LANL, sandia, LLNL, argonne, etc) NFS is used 
extensively for this purpose since the amount of storage required for 
simulation outputs greatly outstrips the storage that any one machine 
can provide, especially the compute nodes. before i switched my email 
address i would get regular notifications that NFS filesystems were down 
for this-or-that many hours at compute facility X. from my observations 
redundancy is the biggest problem with NFS and that its ability to 
efficiently serve up data is more than ample.

AFS provides additional redundancy via volume replication and having the 
various services that comprise it spread over several machines. there is 
a lot of documentation to go through tho.

cheers,
jake

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
Re: Webservers with Terrabytes of Data in - recomended setups, Jacob Yocom-Piatt, (Wed Apr 18, 5:02 am)
Re: Webservers with Terrabytes of Data in - recomended setups, Joachim Schipper, (Thu Apr 19, 2:21 pm)
Re: Webservers with Terrabytes of Data in - recomended setups, Stuart Henderson, (Thu Apr 19, 2:51 pm)
Re: Webservers with Terrabytes of Data in - recomended setups, Joachim Schipper, (Thu Apr 19, 3:23 pm)
Re: Webservers with Terrabytes of Data in - recomended setups, Stuart Henderson, (Thu Apr 19, 3:44 pm)
Re: Webservers with Terrabytes of Data in - recomended setups, Joachim Schipper, (Fri Apr 20, 5:42 am)
Re: Webservers with Terrabytes of Data in - recomended setups, Jacob Yocom-Piatt, (Fri Apr 20, 7:03 am)
Re: Webservers with Terrabytes of Data in - recomended setups, Joachim Schipper, (Fri Apr 20, 11:29 am)
what's the best way to configure a 3.75TB datastore?, John Brahy, (Thu May 10, 12:03 pm)
Re: what's the best way to configure a 3.75TB datastore?, Matt Bettinger, (Thu May 10, 12:21 pm)
Re: what's the best way to configure a 3.75TB datastore?, Timo Schoeler, (Thu May 10, 12:40 pm)
Re: what's the best way to configure a 3.75TB datastore?, Jimmy Mitchener, (Thu May 10, 2:46 pm)
Re: what's the best way to configure a 3.75TB datastore?, Joachim Schipper, (Thu May 10, 2:58 pm)