GXP

Free and open source shell tool
Download

GXP Ranking & Summary

Advertisement

  • Rating:
  • License:
  • GPL
  • Price:
  • FREE
  • Publisher Name:
  • Taura lab
  • Publisher web site:
  • http://www.logos.t.u-tokyo.ac.jp
  • Operating Systems:
  • macOS
  • File Size:
  • 747 KB
  • Release Date:
  • 2021-06-18 14:32:06

GXP Tags


GXP Description

Free and open source shell tool GXP is a free and open source parallel shell tool that can work on any machine reachable via one of these "remote-exec" commands (ssh, batch queuing commands, rsh, etc.).Machines may be in your office LAN, in a cluster, or in multiple LANs/clusters widely distributed. These machines may be behind NAT routers or firewalls, as long as you can reach them via multiple hops of remote-exec commands (e.g., ssh to a gateway and then to hosts behind firewalls). No matter where they are, GXP connects all reachable machines with underlying remote-exec commands and lets you operate them very efficiently.With a single stroke of typing a command, you can invoke it on hundreds of computers in seconds. Here are some key features of "GXP": Easy to install: · When you use GXP on many hosts (as you probably do), you need to install it only on one host. GXP automatically copies itself to remote hosts you run commands on, as necessary. It is written in Python so installation only takes download + PATH setting (plus whatever your underlying remote-exec commands demand for successful authentication). Fast in distributed environments: · GXP brings up daemon processes on hosts you run commands on and keeps them running until you quit a session. It does not require connection establishment and authentication for every single command submission. This feature makes operations fast especially in distributed environments where some hosts are remote, and in large scale environments having many hosts. Scalable: · Daemon processes are connected in a tree structure so as to keep the number of processes directly connected to a single process below a constant threshold. Thus GXP comfortably scales to hundreds of processes without stressing the root host. Interactive: · GXP allows you to interactively specify hosts on which you bring up daemons and then select hosts to run commands on. It keeps these configurations in a session state. In a simple cluster-like enviroment, you typically need only a few interactions with GXP to run commands in parallel on cluster hosts. In more complex and heterogeneous environments, you can write whatever configurations are necessary just as a shell script you are familar with. Useful for parallel processing: · GXP accompanies a tool to perform so-called "embarrassingly parallel tasks" with a trivial amount of learning and setting. It does not need any other infrastructure (e.g., batch queueing system). Requirements: · Python What's New in This Release: · fixed a bug that slowly explores even after --chidren_hard_limit reached. For example, when we do use ssh A B explore --chilidren_hard_limit 10 B 100 the intended behavior is to grab 10 nodes and fail to get the remaining 90 nodes. What happens was, however, to get the remaining 90 very slowly (one after another). On tsubame, this resulted in taking 20 mins to get 130 nodes and got killed by the admin. 2009-05-23 Taura · gxpbin/xmake : fixed links from state.html -> state.txt and other state_xx.html's 2009-06-6 Taura · gxpbin/xmake : defined GXP_MAKE_WORK_IDX and GXP_MAKE_MKSH_PID in job environment


GXP Related Software