Vince, Stinson, looks like just me and Jim Irvine attending this one may 
suffice since this is a working group meeting.  As the note describes below, 
there will be a separate trip for you guys and me to determine long-term 
involvement, etc... Let me now when to schedule.

Vince and Stinson may want to
wait until KC Claffy or I can visit Portland, or have several Enron
reps visit San Diego for demos and related discussions.


Ravi.
----- Forwarded by Ravi Thuraisingham/Enron Communications on 02/29/00 01:28 
PM -----

	tmonk@caida.org
	02/29/00 09:18 AM
		 
		 To: Ravi Thuraisingham/Enron Communications@Enron Communications
		 cc: amy@caida.org, tmonk@caida.org
		 Subject: [amy@SDSC.EDU: Re: CAIDA 'Metrics' WG meeting, 2 Mar 00 (fwd)]



Ravi,

Hi, Amy forwarded me your note.  Since Thursday is the kick off
discussions for the new working group, it might not be the ideal venue
for Enron to get acquainted with CAIDA.  Vince and Stinson may want to
wait until KC Claffy or I can visit Portland, or have several Enron
reps visit San Diego for demos and related discussions.

We have been talking to Stan Hanks for some time about Enron's
interests in passive measurement and are in the process of implementing
some of the performance features in CoralReef that he has described as
relevant to Enron.  Examples of existing CoralReef analyses on OC3/12
links can be found at:

 https://anala.caida.org/CoralReef/Demos/cerfnet/link/
 (real-time)

 https://anala.caida.org/AIX/
 (post-processed traces)

We are also working to better tune the skitter tool for reachability
analysis and for use by providers, an example of some existing
analyses can be found at

http://www.caida.org/Tools/Skitter/Summary/sjc.skitter.caida.org/20000227/

For end-to-end measurements, including those relating to service level
guarantees, we are working to make skping and sktrace more useful to
providers and their NOC personnel, see

 http://www.caida.org/Tools/Skitter/skping/

Another tool of relevance to providers is our cflowd which analyzes
flow export data from Cisco routers, see
http://www.caida.org/Tools/cflowd/.

We would appreciate the opportunity to talk with Enron personnel about
how to make these tools more relevant and useful to your needs,
however, it is doubtful that we will have time to discuss specific
tools on Thursday.

We look forward to meeting you soon!

Take care,

Tracie Monk
Director, CAIDA
858/822-0943

---------- Forwarded message ----------
To: amy@sdsc.edu
cc: Christine_Blair@enron.net, Kristy_Carnes@enron.net
Date: Thu, 24 Feb 2000 19:52:00 -0600
Subject: Re: CAIDA 'Metrics' WG meeting, 2 Mar 00 (fwd)



Hi Amy, Jim Irvine (EBS head of Network Planning) and I (Team Lead, EBS
Research) will attend the meeting. We will have our assistances (Christine 
Blair
& Kristy Carnes, respectively) arrange the trip.  We will plan to come in the
night before and return on March 2,00.

Also, either Vince Kaminski (MD and Head of Enron Research) or Stinson Gibner
(VP, Enron Research) may also attend.  They will let me know shortly if they
plan to attend.

Regards,

Ravi.

P.S. Our company name has been changed to Enron Broadband Services
Kristy, Christine please make the appropriate travel arrangements. The place,
time, etc. are listed.



|--------+----------------------->
|        |          amy@sdsc.edu |
|        |                       |
|        |          02/24/00     |
|        |          07:07 PM     |
|        |                       |
|--------+----------------------->
  
>----------------------------------------------------------------------------|
  
|                                                                            |
  |       To:     Ravi Thuraisingham/Enron Communications@Enron 
Communications |
  |       cc:                                                                 
 |
  |       Subject:     CAIDA 'Metrics' WG meeting, 2 Mar 00 
(fwd)              |
  
>----------------------------------------------------------------------------|






Hi Ravi,

I wanted to follow up directly with you and see if you or anyone at Enron
had any interest in participating in the proposed CAIDA "Metrics" working
group meeting?

Please let me know.

Amy E. Blanchard
CAIDA

%%%%%%%%%%%%%
e-mail: amy@caida.org
phone: (858) 534-8338
fax:   (858) 534-5117


   B.  WG Charters, Meeting on 2 Mar 00


I believe that we should instead run a single CAIDA Working Group
on 'Network Metrics,' rather than the two proposed earlier.  My draft
of its charter is appended below.  It focuses on producing educational
material about network measurement, and on developing new metrics - these
were the two areas of greatest interest amongst the CAIDA members.

The WG co-chairs are
  Sue Moon (SprintLabs) and Brett Watson (MFN/Abovenet)

You are invited to attend the first WG meeting.
The agenda is as follows ..

   Agenda for CAIDA WG meeting on: Thursday 2 Mar 00
                                   -----------------
   10 am - 4 pm, AboveNet, Downtown SJC (see below for details)
   ------------            ------------

   1. Review WG Charter
      - Is it reasonable as set out in the draft?
      - What should be removed or added?

   2. Work through revised charter in detail
      - Identify the work required for each part
      - Determine who's willing to work on it
      - Attempt to determine delivery times

   3. Discussion of new metrics
      - First attempt at making a list of metrics to be considered

   4. Anything else ?

Location: AboveNet is located in the Knight-Ridder Building,
attached to the Fairmont Hotel complex.  The address is

  50 W. San Fernando St.
  San Jose, CA  95113

RSVP: To help us with organising the meeting, please send email to
   nevil@caida.org telling us how many will attend from
   your organisation.


Cheers, Nevil

-------------------------------------------------------------
   Nevil Brownlee                     Visiting Researcher
   Phone: (619) 822 0893                 CAIDA, San Diego


CAIDA Network Metrics Working Group: Draft Charter, Tue 23 Feb 00

Goals:
 1 Education
   + FAQ on What does 'measuring the Internet actually mean?'
     - Why measure anyway?
     - What can be measured?  How?  Where?  By whom?
     - Active vs passive, end-to-end vs provider network only,
       application vs transport layer
     - Rating schemes: provider 'net performance' pages, Internet
       'Weather Map's, Keynote, etc.
     Publish as CAIDA web pages, or maybe as an Info RFC

   + Survey paper on metrics and Internet Measurement
     - Current measurement efforts (Surveyor, RIPE Test Traffic,
       AMP, IPERF, AT&T, Keynote,skitter, ...)
     - Current tools
     Publish as CAIDA web pages

 2 Service Metrics
   + Define new metrics
     - Taxonomy of current metrics (IPPM, RTFM, ITU, ..)
     - Summary of metrics used for current services
     - Gather information/ideas about new/emerging services,
       especially DiffServ-based ones
     - Make list of new metrics, either to improve measurement of
       existing services or to support new ones
       [list of 'metrics' questions (Appendix A) goes here]

   + Organise experimental implementation/testing of tools
     for new metrics

   + Make recommendations on implementation
     - Define core set of 'really useful' metrics
     - recommend that CAIDA implement these as a
       'Service Measurement Toolkit'

   + Publish new metric definitions through IPPM or RTFM

   + Produce document "measurement requirements for hardware/software
     vendors."  Publish on CAIDA web pages


-------------------------------------------------------------------------

Appendix A: Questions from the earlier draft CAIDA WG charters


 a. What types of network- and transport-layer metrics are being
    used by ISPs in engineering and operating their networks?
    By Customers for verifying service guarantees?
 b. What new services are being (or are likely to be) offered, e.g.
    DIFFSERV?  Is there a need for higher-layer metrics to better
    monitor and manage these services?
 c. Will these new differentiated transport- and
    application-layer services need new metrics?
 d. How can the service metrics be measured in a multi-ISP
    environment?
 e. How can customers verify these measurements?
 f. What requirements would service measurement introduce for
    equipment vendors?


 g. How relevant are specific techniques (e.g. which flow) and
    points of measurement to specific users (ISP, customer, etc.)
    requirements?
 h. How do these metrics relate to network behavior as perceived
    by users? How do they correlate with performance?

-------------------------------------------------------------------------

Appendix B: Background on the IETF Working Groups


* RTFM WG: Realtime traffic Flow Measurement

RTFM is concerned with passive measurements of two-way traffic flows,
specified in terms of their end-point attributes.  Its primary goal was

To produce an improved Traffic Flow Measurement Model considering at least the
following needs:

 a. Wider range of measurable quantities, e.g. those
    relating to IPv6, and to class of service
 b. Simpler ways to specify flows of interest
 c. Better ways to control access to measured flow data
 d. Strong focus on data reduction capabilities
 e. Efficient hardware implementation


* IPPM WG: IP Performance Measurement

The IPPM WG charter is to develop a set of standard metrics that can
be applied to the quality, performance, and reliability of Internet
data delivery services. These metrics will be designed such that they
can be performed by network operators, end users, or independent
testing groups. It is important that the metrics not represent a value
judgement (i.e. define "good" and "bad"), but rather provide unbiased
quantitative measures of performance.

RFCs
  Framework for IP Performance Metrics (RFC 2330)
  Metrics:
     Connectivity (RFC 2678),
     One-way Delay (RFC 2679), One-way Packet Loss (RFC 2680)
     Round-trip Delay (RFC 2681)

I-Ds
     Bulk Transfer Capacity (2x)
     Instantaneous Packet Delay Variation
     One-way Loss Patterns


* Other WGs

The RMONMIB WG is thinking about 'Application Performance
Measurement.'  This is clearly a hard problem (e.g. does this just
mean response-time measurement, can it be done by passive means, how
should the measurements be presented, etc.).


In short
 - RTFM provides a good distributed measuring system for traffic
   volumes
 - IPPM has concentrated on transport-layer behaviour of the
   current, best-effort Internet.
 - RMONMIB is beginning to consider application-layer measurement

-------------------------------------------------------------------------





-----End of forwarded message-----