Experiment

Protocol - 11/28/07
Perform a simple experiment to measure a thoughput of different protocols between 2 nodes connected with 4X SDR InfiniBand network.

• Protocols:
  • IPoIB-CM: IP over InfiniBand - connected mode via the reliable connected (RC) transport
  • IPoIB: IP over InfiniBand via the unreliable datagram (UD) transport
  • SDP: Sockets Direct Protocol via the reliable connected (RC) transport
  • IB RC: InfiniBand Verbs via the reliable connected (RC) transport
  • IB UC: InfiniBand Verbs via the unreliable connected (UC) transport
  • IB UD: InfiniBand Verbs via the unreliable datagram (UD) transport
• Tools: ttcp (version 1.12, release 14.1) and ib_send_bw (ofed 1.2.5.3)
• Nodes: node1 (via ib301), node2 (via ib302)
• Packet Size: 2 bytes -8 Mbytes
• Network:
  
• MTU (bytes):
  • IPoIB-CM: 65536
  • IPoIB: 2044
  • SDP: N/A
  • IB RC: 2048
  • IB UC: 2048
  • IB UD: 2048
• Tool used:
  • IPoIB-CM: ttcp
  • IPoIB: ttcp
  • SDP: ttcp
  • IB RC: ib_send_bw
  • IB UC: ib_send_bw
  • IB UD: ib_send_bw
• Results:
  

Bandwidth - 11/27/07
Perform a simple experiment to measure a thoughput between 2 nodes connected with 4X SDR InfiniBand network.

• Tools: ttcp (version 1.12, release 14.1) and ib_send_bw (ofed 1.2.5.3)
• Nodes: node1 (via ib301), node2 (via ib302)
• Packet Size: 2 bytes -8 Mbytes
• Network:
  
• Results:
  

Latency - 11/27/07
Perform a simple experiment to measure a latency between 2 nodes connected with 4X SDR InfiniBand network.

• Tools: ib_send_lat (ofed 1.2.5.3)
• Nodes: node1 (via ib301), node2 (via ib302)
• Packet Size: 2 bytes
• Network:
  
• Results:
  • Typical: 5.30 µsec
  • Minimum: 4.34 µsec
  • Maximum: 41.75 µsec