  Beowulf Cluster
  ȯ (jhpark@nurapt.kaist.ac.kr)
  1998 10 28

    Beowulf Cluster   ҰԴϴ.
  ______________________________________________________________________

  

  1. Ұ
  2. Beowulf Cluster
  3. Beowulf Cluster - GALAXY
  4. ġ鼭

  ______________________________________________________________________

  1.  Ұ

  , DB , ϼ, FTP , PROXY     ȯ濡
     , , ȼ   н  NT
  غ   ݴ ɺ  Ź  
    ̸   Ʈ  ݽ ,
  Ŭ, ͽ, ڷ        OSμ
  ο ⸦ ° ִ. ̿  ʰ ǻ ӵ ֿ켱 ϴ
  ũ ǻ ȯ濡 ̹   μ  
  ̼ Ź εҼ    ο   ް
  , SGI, IBM, SUN, HP, DEC  Ǿ ũ ǻ
   ޼ ӵ   İ  ,  
   μ SMP ӹ ʰ,   Ʈŷ 
  Ʈ Ŭ͸ Ͽ  ǻ  ϰ  .

   Ʈ Ŭ   Beowulf cluster 1994 NASA
  CESDIS 16 node cluster  ǥ Ʈ Ű
  ̿Ͽ Ͽµ, ̷    NASA  CRAY
  Ӵ Ⱓ  Ҿ ο ó  ǻ 
  غڴ Ⱑ ־. ̶  Ʈ ̹ 
  CESDIS  ֵ  ̷  θ ǰ ִ.

  ȭ 'ŸŸ' 128   ŬƮ ̿ ó
  Ͽ     ־  ̱ ν
  ˶  ҿ  ϵ ǸŶ  
  ִ 70   ڽ  Avalon̶ Beowulf ý 
   ,  Top500 supercomputers list
  (http://www.top500.org/top500.list.html)  315  Ǿ ִ.
     ǻͷδ SGI 64 μ ϴ ORIGIN
  2000 ý(304)̴.     ǻ ȯ
  뺯ϵ 315 ̻ ϵ  ǻʹ 6,
  ̰ко߷δ SERI, KT, Ｚ ϰ   ,  ̳ Ϲ
  ҿ   ǻʹ  ̴.

  Avalon  Beowulf cluster Ư¡  캸, 츮 
   ִ   ڽ ̿Ͽ   Ư  
  ġ   Ͽ,  ڽ  Ŀ
  ö̿  ġ  ׿ ׽ ġ ʿġ ʴ  Ư¡
     ,      ũ Ҽ ִ.

   ۿ PC hardware Ͽ  ǻÿ ϰ ִ Beowulf
  cluster Ư¡  ε 캸, Beowulf Ŭ͸ ϱ
   ʿ ϵ Ʈ ȯ  ڰ غ 4-node mini
  beowulf ŬͿ ؼ Ұ  ǻ  ϰ ִ
    ٸ  Ұҷ Ѵ.

  2.  Beowulf Cluster

   ϰ ִ  Ӹ ƴ϶,   "better, faster,
  cheaper" ǻ͸ ϰ ִ. ׷, ̼  غ
    ˰, ̷ ٷ ָ -  ǻ ̸
  츮 ߾˰ ִ ũ̼ , HP, SGI, SUN, DEC ǰ
     ̷ ٷ ޸   ϳ , PC ణ
   ӵ  û   ؾ ϴ 츦  ȴ. Ư
  ̷ - ǻ ȯ濡 ѵ     ý۰
  ϵ Ʈ ȣȯ  PC  ڰ 
  Ͽ  Ʈ ġϿ Ѵٴ   Ҽ 
  ̴. 翬 ̷  Ư  ϵ Ʈ 
  Ҽ ۿ          ̴.
  ̷  - ǻ ȯ  NASA Beowulf
  Ʈ ̸, 忡   ִ PC ϵ 
  Ҽ   Ʈ  ̿ ̿ ǻ 
   ο õ ϰ Ǿ.

  Beowulf Ʈ ϰ   ߿  PC
  μ(Intel x86, DEC Alpha, Power PC) ޼ ̴. ٷ
   εҼ 꿡 ȹ  ־, PC μ 
  ӵ ̹  - μ 3̻ , 
  밡   μ ̹  ӵ . ̿ Ҿ 
  н  ̼ǿ  Ǿ SCSI  ȭ ׸,
  Ʈ  ޼  Ҿ 100Mbps switching hub
  ϶  Beowulf Ŭ͸   ִ ϵ
  PC    . (ܱ 100Mbps switching
  hub Ʈ 100 ̸  ,   ̴.)

   ̷ ϵ  Beowulf Ʈ Ҽ ־
    ƴϴ. ̷  ٸ  ΰ ؿ ϵ
   ϳ ý Ͽ Beowulf  ο Ÿ
  ǻ͸   ̴. ʹ  ƴ , 
    н   ȯ Ͽµ, ٷ ҽ ڵ
  100%  Beowulf cluster ϰ Ӱ ҽ ڵ带 ϰ
  Ӱ Ͽ Ҽ ִ ȯ Ͽµ, ̷ 
   ٸ  Ʈ Ͽ ̴.  ̿ܿ MPI,
  PVM message passing library ǥȭ ̷  ǻͿ
   Beowulf cluster  Ӱ Ҽ ְ  
  Cray ϴ  ǻͿ ؼ Desktop PC ϰ
  α׷ ۾ Ҽ ְ Ǿ.

   ǻ͸  캸, RC5/DES ũ 
  internet  ǻ ͵鵵 ϳ ó ǻͷ 
  , ̿ ݴ   ǻͷμ ʰ Ʈũ  MPP,
  vector, SIMD cluster ִ. ̷   ǻʹ ý 
  ΰ  ð  ޼ ϰ ִ ũ μ
  ﰢ ϱ    ִ ݸ Beowulf Cluster 
  node  OS    local area network ̷
  ֱ  پ Ȯ强 , ޼ ϰ ִ  ũ
  μ ﰢ ϱⰡ ϴ.  SUN 
  ̼ ̿  network clustering   , 
   Ȯ强 Ѱ踦  ȴ. Beowulf cluster  slave node
  ⺻ M/B, RAM, NIC, CPU  Ű, 콺,  ʹ
  ⸦ Ͽ master node ü node ϰ 
  ó ȴٴ  Ϲ workstation cluster еȴ.
    beowulf cluster switching hub   cross linkϿ 2
  node    µ  node CPU 2 ġѴٸ  4
  processor mini beowulf cluster   . ʱ beowulf cluster
  8-node Ǵ 16-node ethernet  Ͽ,   
   Beowulf cluster ϱ ؼ shared 100MBPS Ϲ fast
  ethernet hub    node network I/O bandwidth ϱ
  ؼ dedicated 100MBPS ϴ switching hub ʼ̴. 
  16Ʈ switch   ִ 16 node    , network
  I/O bandwidth    node NIC ߰ ġϿ network
  channel bonding Ͽ node پ, Ʈ 뿪
  ų ִ. (⼭   node M/B   node
  dual Ǵ quad cpuε ϴ.)

  100 node̻ ġϿ ϰ ִ  밳 gigabit uplink 
  100MBPS switch  Ͽ  node Ű ̷ switch
  gigabit switch Ͽ  node network   I/O bandwidth
  ս ּȭ Ѵ. ̷  Ʈ   ش 츦
  ϸ, beowulf cluster Ʈ  Ʋ, Intel Pentium
  Pro CPU 9152   ASCI  Red System ( Top500 list
  1) beowulf cluster ɼ     ̴. ̿
  , Beowulf cluster  node 忡    ִ PC
  ϵ , Ʈ  Ǵ  ܷμ, ü
  Beowulf cluster ߿ ū κ ϰ   ߴ޷
  Myrinet ο Ʈ  ϰ , channel bonding
  Ʈ   ݴ ɺ񿡼 ū ȿ  ϰ ־
   θ ǰ  ϴ.

  3.  Beowulf Cluster - GALAXY

   Beowulf cluster  Ϲ Ư¡ Ŀ ؼ
   Ͽ. ⼭ ڰ  غ Beowulf cluster
   Ư¡ ؼ  Ұ ϰڴ.   software
  ð LINUX HOW-TO    Ƿ ϱ ٶ.

  97   ǿ SUN Sparc 20 HP C180 ý ϰ
  ־, ǿ  ġ귮 ϱ⿡ ̾  
  ο ý ã  ռ  ٿ  Ƽ ο 
  ġϿ ϴ  ݴ ɺ ̶ Ǵ Ʒ Ƽ
  (200MHz) Ͽ  ġϰ,  ڵ Ű
  ġϿ  Ȱ ϱ    ó ũ
  ǻÿ ̿ ̾.       ϴ ó 
  ߴٰ NT ߴٰ ϸ鼭 ̰  峭 ĺ ܰ迴 ,
    Ȱϱ ó̾.   97 ܿ  ƼII
  300MHz ׷ Ͽ, ó ο ΰ 98  ̱
  ƼII 300MHz δ븦  Ͽ 1GB SCSIϵ忡 OS ġϰ
  NFS ̿ؼ  丮 ý۰  Ͽ  Ͽ.
  ̶ о Monte Carloù̼ ϴ ڵ尡 PVM library
  ̿ ó  Ͽ , g77 PVM library ̿Ͽ
  Ͽ ϰ Ǿ. Monte Carlo ù̼ Ư α׷
  ۰   node鰣 Ÿ  ʿϱ  , shared
  10Mbpsȯ濡 ϰ μ ŭ, 4 ӵ
     ϰ Ͽ. ׷ shared 10Mbpsȯ濡
  4 μ Ͽ number crunching ۾ ϱ⿡ ʹ 
  ȯ̾  Ͽ, 7 KAIST Backbone network 
  FDDI ATM ϸ鼭 enduser dedicated 10MBPS Կ
  , ǳ Baynetwork  24Ʈ 10/100M Switch
  BayStack 350T-HD ϰ Ǿ.

   ý Ӱ workstation cluster ƴ, Beowulf-class
  ý ϱ  , ϴ master node ϵ ũ ϰ
  slave node diskless Ͽ  ִ OS 1GB SCSIϵ带 ϰ
  slave node M/B, 1 CPU, 10/100M NIC, 64MB RAM, ISA VGA, keyboardθ
   Ͽ.  VGA ʿ, ý  ϱ, ¿
   ٴϴ ISA  ī带 Ȱ Ǿ mini beowulf ý̶
  Ű ⸦  Ͽ master node ü ϴ  ϴ
   ʾҴ.  ̿ ݸ鿡 master node  M/B, 2 CPU, 2 10/100M
  NIC, 512MB RAM, 22GB SCSI HDD, PCI VGA Ͽ.  ϴ BayStack
  350T-HD VLAN  ̿Ͽ 24Ʈ Beowulf cluster ϴ 3
  Ʈ VLAN2  ϰ,  Ʈ VLAN1 ϵ Ͽ, Master
  node 2 NIC ġϿµ eth0 VLAN1  Ͽ ܺ
  Ʈ ٰϰ ϰ eth1 VLAN2 Ͽ node鰣
  private network Ͽ.

     RedHat 5.1μ, RedHat翡 NASA CESDIS
  Բ Extreme Linux RedHat 5.0 Ͽ  X86  Beowulf
  cluster  Ǹϰ    anonymous ftp server 
  ٿε  ִ. ڰ ġ ñ⿡ anonymous ftp
  serverκ ٿε   ִ Ȳ,  ÿ Extreme
  Linux Ҽ , 5.0 ϰ ־ ٸ ޸Ʈ  
  RedHat 5.1 ġϰ   Ʈ  ġϿ. ׷,
  Intel X86ȯ濡 NIC  忡 2徿 Ͽ channel bondingϿ
  node network 뿪 2 Űų Ʈ ġ 
   Ѵٸ, Extreme Linux ϴ  ٶ  .

  Master node diskless slave node  NFS-ROOT server ǰ
  Ͽ, NIS ġ  ʰ  node  /tftpboot 丮
  passwd, group  master node ϰ ϵ帵ũ ѳҴ.
  slave bootp  ip address Ҽ ְ Ͽ, DNS 
   ġϿ private network node鰣 Ʈ ȯ濡 
   Ͽ.  ġ   Ʈ պκп  ASCI Red
  ǻͿ  Ƽ   BLAS, FFT math library
  ġϿ, message passing library, MPICH, LAM MPI, PVM ġϿ
   尣 message passing  ó ϰ Ͽ, Ÿ
   ó math library ġϿ. Beowulf cluster ڵ
  master nodeθ Ʈ   ϱ , master node job
  ߵ  Ͽ  ұԸ ý, DQS Ͽ
  ڵ batch job ϰ Ͽ ڵ job μ
  յ  Ҽ ְ Ͽ,  ̷ ġ Beowulf
  System ؼ NAS Parallel Benchmarks (NPB) ̿Ͽ ׽Ʈ
  غ    PETSc Ŷ ̿ؼ
  α׷Ͽ ׽Ʈ غҴ. ׽Ʈغ鼭  
  Ÿµ, ϴ CPU 4 ݸ鿡 NIC 3 Ÿ 
  ߰ߵǾ ణ  ϰ Ÿ  ߰Ͽ. Ȯ parallel
  benchmark   ,  85% ̻ parallel efficiency
  ־, NIC ϳ ߰ϰ channel bonding Ѵٸ  
  ȿ ý ɰ̶ ȴ.

  4.  ġ鼭

  ª ,  ǻÿ ϰ ִ  ؼ ϰ
  ҰϿ.  ̷  Beowulf cluster Ϲ  ̿ڰ
  ϱ⿡ Ÿ ־ ,   ȯ õ 
   ,  Ȯ ʰ  ʿϴ ũ
  ǻ    ϴ   ɼ 
  ִ.

  88     ط 10 Ѱ Ǿ, 
     ʴǴ  , κ '̸'  찡
  κ, Ը鿡 ̱ 111 1, Ϻ  40 1, EU
  30 1ؿ Ұ   ؼ ϱ⸸ ϴ.
  IMF   Ǿȭ SERI ǻ 3ȣ  
   Ȳ̸,   񳭸  û űԷ 1õ
  3鸸޷ 100GFLOPS 󿹺 ĸ Կ̴. ̷
   Ȳ  ռ  ν˶  20GFLOPS 
  ɷ , 15 ޷¥ home made supercomputer, Avalon 
  ''    ش. ̷     ,
  ̶ũ,     beowulf cluster  ?
  ϱ⵵ Ѵ.

  Beowulf cluster  ǻͿ   1/10, ׷
  鿡 δ  . ׷,  а PC뿡  ִ Window
  о,  ġѴٸ   Ը beowulf cluster 
   ,  KAIST   ȯ̶  master
  node network  ʱ شٸ,  ǿ slave node
    ڽ ϳ  ߰ ġϿ  ǻ
  ȯ          üϿ
  ٽ  Ƿ    ̴.

  ,   ̶  ̼Ǹ    
  2 Dual PII   ڽ channel bondingϿ cross cable 
  غ.   switching hub ̵ 4 processor beowulf cluster
  ɿ Ƹ  ̴.

