=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
rsync

NiLe
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
NiLe is a worm that propagates via SSH to execute commands in a given list of hosts and copy files to them with rsync. In execute mode it can either launch a shell command in a given list of hosts, upload a perl script to their memory and execute it, upload a hacked bash script, or execute a bash command without waiting for it to finish and redirecting its output to a remote file. In copy mode it is able to syncronize repositories (one master to many slaves) via rsync over ssh.

It was designed and written by Hegoi Garitaonandia (hegoi@ifae.es,hegoi.garitaonandia@cern.ch)

NiLe 2.2.2 released

Feb 14th, 2007

Redesign of the timeouts. Now there are three timeouts, soft stop timeout (this was the old timeout), hard stop timeout, and SSH timeout. The soft stop procedure is much cleaner than before. The logging module now allows to write to the disks of every compuer that the worm touches.

NiLe 2.1.5 released

Jan 18th, 2007

Timeout to individual connections added, and a new log module for easier debugging.

NiLe is now licensed under GPL

May 25th, 2006

NiLe 2.0.7 released

May 25th, 2006

Some bug fixes were corrected in the main algorithm.

NiLe becomes part of the official ATLAS project of CERN organization

Apr 10th, 2006

NiLe is now an element used to debug and cleanup part of the ATLAS filtering software: TDAQ. TDAQ is a parallel software that will run in about 1000 computers. During development phase, the yet buggy TDAQ software leaves garbage in the computers where it is tested. NiLe is used as an external by the ShifterTools package as reliable command transport mechanism for many monitoring and user level administration activities of the cluster.

Article about NiLe published in "Computing in High Energy Phisycs 2006" conference

Feb 15th, 2006

The article "Worm and Peer To Peer Distribution of ATLAS Trigger and DAQ Software to Computer Clusters" was published.

NiLe 2.0.5 released

Febrary 3rd, 2006

It is now possible to skip working host. It can also read filelists and farmdescriptionlists (and custom commands) from a pipe.

NiLe 2.0.2 released

Febrary 1st, 2006

Custom commands can be run on different computers. There is not the need of running the same command on everycomputer anymore. This feature is independent from the routing mechaninsm.

NiLe 2.0.1 released

January 23rd, 2006

Nile version 2.0.1 has been released. With most of its planned features, but still with small bugs. Clean shutdown feature added. Moreover, the remote process are run in a sandbox, so the concept of NiLe network begins here. Now, rsync can run on top of TCP, so it performs much better for high speed networks. In fact, the copy command is configurable, with a tiny NiLe language.

NiLe is being used by ATLAS TDAQ Sysadmin group to synchronize every day 20GB in 90 machines

January 23rd, 2006

NiLe's copy feature has been adapted as disk synchronization mechanism in two laboratories (of 30 and 60 machines) at CERN. It synchronizes (in the 60 machine laboratory) 20GB in 25 minutes.

NiLe 1.0.0 released

June 1st, 2005

Nile version 1.0.0 has been released. Custom routing paths feature added, and also compensation algorithm for broken paths.

NiLe 0.9.0 released

March 13th, 2005

Nile version 0.9.0 has been released. Equals Rgang functionality.


=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Google