Menu

Jon Dugan

Jon Dugan

Jon Dugan is based in Chicago, Illinois. His professional experience has centered around UNIX-like systems, IP networking and programming. His first years in UNIX system administration were at Wolfram Research.  He spent many years at the National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign in Urbana, IL first as a student employee, then as a network engineer and finally as a senior network engineer. He recently joined ESnet at Lawrence Berkeley National Lab as a network engineer where he is involved in network engineering and tool development.

Dugan has been very active with the SCinet committee of SC Conference Series since 1998.  He developed the software used to track all of the internal state for SCinet, including booth connection requests, fiber management, IP address allocation and DNS management. This system started as a Perl CGI script, but was then rewritten in Java using the Turbine framework which was in turn ported to Quixote and finally Django. In 2005 he was the Vice Chair of SCinet which was interesting but not as interesting as being a worker bee.

Dugan has always had an interest in graphic design and visual communications and has dabbled in web design. He is also interested in operating systems research including Plan 9. In the last several years he has become very interested in electronics and embedded systems. He has been exploring the AVR and ARM microcontroller platforms. Recently he has also been learning about the Go programming language which has a very interesting approach to concurrency.

Conference Papers

Mariam Kiran, Peter Murphy, Inder Monga, Jon Dugan, Sartaj Baveja, “Lambda Architecture for Cost-effective Batch and Speed Big Data processing”, First Workshop on Data-Centric Infrastructure for Big Data Science (DIBS), October 29, 2015,

This paper presents an implementation of the lambda architecture design pattern to construct a data-handling backend on Amazon EC2, providing high throughput, dense and intense data demand delivered as services, minimizing the cost of the network maintenance. This paper combines ideas from database management, cost models, query management and cloud computing to present a general architecture that could be applied in any given scenario where affordable online data processing of Big Datasets is needed. The results are presented with a case study of processing router sensor data on the current ESnet network data as a working example of the approach. The results showcase a reduction in cost and argue benefits for performing online analysis and anomaly detection for sensor data

Karel van der Veldt, Inder Monga, Jon Dugan, Cees de Laat, Paola Grosso, “Carbon-aware path provisioning for NRENs”, International Green Computing Conference, November 3, 2014,

 

National Research and Education Networks (NRENs) are becoming keener in providing information on the energy consumption of their equipment. However there are only few NRENs trying to use the available information to reduce power consumption and/or carbon footprint. We set out to study the impact that deploying energy-aware networking devices may have in terms of CO2 emissions, taking the ESnet network as use case. We defined a model that can be used to select paths that lead to a lower impact on the CO2 footprint of the network. We implemented a simulation of the ESnet network using our model to investigate the CO2 footprint under different traffic conditions. Our results suggest that NRENs such as ESnet could reduce their network’s environmental impact if they would deploy energy- aware hardware combined with paths setup tailored to reduction of carbon footprint. This could be achieved by modification of the current path provisioning systems used in the NREN community. 

 

Jon Dugan, Gopal Vaswani, Gregory Bell, Inder Monga, “The MyESnet Portal: Making the Network Visible”, TERENA 2012 Conference, May 22, 2012,

 

ESnet provides a platform for moving large data sets and accelerating worldwide scientific collaboration. It provides high-bandwidth, reliable connections that link scientists at national laboratories, universities and other research institutions, enabling them to collaborate on some of the world's most important scientific challenges including renewable energy sources, climate science, and the origins of the universe.

ESnet has embarked on a major project to provide substantial visibility into the inner-workings of the network by aggregating diverse data sources, exposing them via web services, and visualizing them with user-centered interfaces. The portal’s strategy is driven by understanding the needs and requirements of ESnet’s user community and carefully providing interfaces to the data to meet those needs. The 'MyESnet Portal' allows users to monitor, troubleshoot, and understand the real time operations of the network and its associated services.

This paper will describe the MyESnet portal and the process of developing it. The data for the portal comes from a wide variety of sources: homegrown systems, commercial products, and even peer networks. Some visualizations from the portal are presented highlighting some interesting and unusual cases such as power consumption and flow data. Developing effective user interfaces is an iterative process. When a new feature is released, users are both interviewed and observed using the site. From this process valuable insights were found concerning what is important to the users and other features and services they may also want. Open source tools were used to build the portal and the pros and cons of these tools are discussed.

 

Presentation/Talks

Jon Dugan, The MyESnet Portal: Making the Network Visible, Summer 2012 ESCC/Internet2 Joint Techs, July 2012,

Jon Dugan, The MyESnet Portal: Making the Network Transparent, TERENA Networking Conference 2012, May 2012,

Jon Dugan, Using Graphite to Visualize Network Data, ESCC Meeting
, Columbus, Ohio, July 15, 2010,

Jon Dugan, Network Monitoring and Visualization at ESnet, Joint Techs
, Salt Lake City, Utah, February 3, 2010,