nodemanager.git
16 years agoFollow convention NodeManager-1.7-3
Faiyaz Ahmed [Fri, 28 Mar 2008 19:47:33 +0000 (19:47 +0000)]
Follow convention

16 years agoPL-4.2rc tag. 1.7-3
Faiyaz Ahmed [Fri, 28 Mar 2008 19:19:50 +0000 (19:19 +0000)]
PL-4.2rc tag.

16 years agoupdated changelog.
Faiyaz Ahmed [Fri, 28 Mar 2008 19:18:26 +0000 (19:18 +0000)]
updated changelog.

16 years agoBump versions
Faiyaz Ahmed [Fri, 28 Mar 2008 17:50:54 +0000 (17:50 +0000)]
Bump versions

16 years agoLatest branch.
Faiyaz Ahmed [Fri, 28 Mar 2008 17:20:11 +0000 (17:20 +0000)]
Latest branch.

16 years agoget config from file.
Faiyaz Ahmed [Thu, 27 Mar 2008 20:34:26 +0000 (20:34 +0000)]
get config from file.

16 years agosort domain name. lower order domains should be first.
Faiyaz Ahmed [Thu, 27 Mar 2008 19:17:51 +0000 (19:17 +0000)]
sort domain name.  lower order domains should be first.

16 years agoroot slice needs to come first. Also, emtpy conf file now handled correctly.
Faiyaz Ahmed [Tue, 25 Mar 2008 19:21:16 +0000 (19:21 +0000)]
root slice needs to come first.  Also, emtpy conf file now handled correctly.

16 years ago* Checks for zombied pids during restart
Faiyaz Ahmed [Tue, 25 Mar 2008 17:35:01 +0000 (17:35 +0000)]
*  Checks for zombied pids during restart
*  Fixed toggling of instantiated slices.

16 years agoadd carriage return to lines
Faiyaz Ahmed [Mon, 24 Mar 2008 21:41:20 +0000 (21:41 +0000)]
add carriage return to lines

16 years agoAdded codemux
Faiyaz Ahmed [Mon, 24 Mar 2008 21:30:00 +0000 (21:30 +0000)]
Added codemux

16 years ago* Now callback in NM by default
Faiyaz Ahmed [Mon, 24 Mar 2008 21:29:32 +0000 (21:29 +0000)]
* Now callback in NM by default
* Clean up after slice is removed

16 years agopath fix.
Faiyaz Ahmed [Mon, 24 Mar 2008 21:00:32 +0000 (21:00 +0000)]
path fix.

16 years agoInitial Commit.
Faiyaz Ahmed [Mon, 24 Mar 2008 20:00:59 +0000 (20:00 +0000)]
Initial Commit.

16 years agoInitial commit.
Faiyaz Ahmed [Mon, 24 Mar 2008 19:50:38 +0000 (19:50 +0000)]
Initial commit.

16 years agomultiple slice falvours - second iteration
Thierry Parmentelat [Sat, 22 Mar 2008 11:03:45 +0000 (11:03 +0000)]
multiple slice falvours - second iteration
* review naming scheme for system slices; now planetflow vref image is named like
  planetflow-f8-i386 for consistency
* use for sensible name for the stamp where default slicefamily is stored

16 years agofixed a couple remaining issues, seems to work
Thierry Parmentelat [Fri, 21 Mar 2008 21:09:39 +0000 (21:09 +0000)]
fixed a couple remaining issues, seems to work

16 years agofixed syntax error
Thierry Parmentelat [Fri, 21 Mar 2008 20:55:48 +0000 (20:55 +0000)]
fixed syntax error

16 years agoCheck to see if slice is running first before creating /vsys directory.
Faiyaz Ahmed [Fri, 21 Mar 2008 18:27:10 +0000 (18:27 +0000)]
Check to see if slice is running first before creating /vsys directory.

16 years agosupport for multiple slice reference images
Thierry Parmentelat [Fri, 21 Mar 2008 16:35:32 +0000 (16:35 +0000)]
support for multiple slice reference images

* vserver-reference rpm names have changed and become
    vserver-@pldistro@-@fcdistro@-@arch@
    vserver-systemslices-@pldistro@-@fcdistro@-@arch@

* this contains the images located as
   /vservers/.vref/@pldistro@-@fcdistro@-@arch@
and
  /vservers/.vstub/@pldistro@-@fcdistro@-@arch@/planetflow
respectively

* a stamp gets created on the nodes as /etc/planetlab/defaultvref
  that contains the name for the default slicefamily to use

* nodemanager tries to be smart when chosing the right argument to pass to vuseradd
  for this purpose, the argument in 'vref' is taken as a dash-separated list of 'wishes'
  so e.g. is defaultvref is planetlab-f8-x86_64, then we should find for the image name:
vref=i386           -> vuseradd -t planetlab-f8-i386
vref=centos5        -> vuseradd -t planetlab-centos5-x86_64
vref=planetflow     -> vuseradd -t planetflow
vref=centos5-onelab -> vuseradd -t onelab-centos5-x86_64

for legacy reasons, if the stamp is not found, 'default' is taken instead

=== status
* this is only partly tested
* a given node can install several variants of vserver-*
  this would require a manual upload of the rpms into the right install-rpms
  and manual changes in yumgroups.
* next improvement would be to have the system (planetflow) slices have a smarter naming scheme as well
  this way a 'planetflow' vref would rather be rewritten as planetflow-f8-x86_64
  for the time being it is not supported to install several variants of vserver-systemslices
  on the node - although it should be harmless

16 years agoBug fix for caching dead slices.
Faiyaz Ahmed [Fri, 7 Mar 2008 22:24:31 +0000 (22:24 +0000)]
Bug fix for caching dead slices.

16 years agoLess noisey logging. Also uses LOG_LEVEL now.
Faiyaz Ahmed [Fri, 7 Mar 2008 20:34:59 +0000 (20:34 +0000)]
Less noisey logging.  Also uses LOG_LEVEL now.

16 years agofixed deletion logic. ..this is sloppy but it works. Also fixed network shares.
Faiyaz Ahmed [Thu, 6 Mar 2008 22:06:13 +0000 (22:06 +0000)]
fixed deletion logic.  ..this is sloppy but it works.  Also fixed network shares.

16 years agoto support pl_mom list emails instead of mails to support
Faiyaz Ahmed [Thu, 6 Mar 2008 16:01:56 +0000 (16:01 +0000)]
to support pl_mom list emails instead of mails to support

16 years agosimple patch for redirecting pl-mom notification to the right mailing list
John Doe [Wed, 5 Mar 2008 09:43:05 +0000 (09:43 +0000)]
simple patch for redirecting pl-mom notification to the right mailing list

16 years agoAdded code to reduce duplicate entries in /etc/vsys.conf; this will help play
Stephen Soltesz [Tue, 4 Mar 2008 19:26:17 +0000 (19:26 +0000)]
Added code to reduce duplicate entries in /etc/vsys.conf; this will help play
more nicely with vsys.

16 years agoAdded stuff for the NM API.
Stephen Soltesz [Fri, 29 Feb 2008 19:27:55 +0000 (19:27 +0000)]
Added stuff for the NM API.

16 years agoScript to automatically upload changes in a drupal page to drupal. Handy for
Stephen Soltesz [Fri, 29 Feb 2008 19:27:12 +0000 (19:27 +0000)]
Script to automatically upload changes in a drupal page to drupal.  Handy for
the api.  This almost works, but not quite.  It worked on a recent myplc, but doesn't
work on the production box.  I don't know why.

16 years agoAdded sharing for loans.
Faiyaz Ahmed [Wed, 27 Feb 2008 14:28:42 +0000 (14:28 +0000)]
Added sharing for loans.

16 years agoConfigures vsys via vsys slice attribute {name: vsys, value: script}
Thierry Parmentelat [Thu, 14 Feb 2008 18:33:10 +0000 (18:33 +0000)]
Configures vsys via vsys slice attribute {name: vsys, value: script}
CPU reservations are now calculated via percentages instead of shares
BW totals preserved for dynamic slices
Closes bug where node cap sets off bw slice alarms for all slices.

Manual fix after a broken module-tag.py attempt

16 years agoInclude vsys.
Faiyaz Ahmed [Wed, 13 Feb 2008 17:25:25 +0000 (17:25 +0000)]
Include vsys.

16 years agoinclude vsys call back.
Faiyaz Ahmed [Wed, 13 Feb 2008 17:24:46 +0000 (17:24 +0000)]
include vsys call back.

16 years agoCleaned up bugs. Now works as advertised.
Faiyaz Ahmed [Wed, 13 Feb 2008 17:15:41 +0000 (17:15 +0000)]
Cleaned up bugs.  Now works as advertised.

16 years agofixed typos.
Faiyaz Ahmed [Mon, 11 Feb 2008 22:35:32 +0000 (22:35 +0000)]
fixed typos.

16 years agoSecure, and configure vsys scripts.
Faiyaz Ahmed [Mon, 11 Feb 2008 21:59:36 +0000 (21:59 +0000)]
Secure, and configure vsys scripts.

16 years agotypo
Faiyaz Ahmed [Thu, 7 Feb 2008 19:50:58 +0000 (19:50 +0000)]
typo

16 years agolong awaited vsys callback. Still in progress.
Faiyaz Ahmed [Wed, 6 Feb 2008 22:05:32 +0000 (22:05 +0000)]
long awaited vsys callback.  Still in progress.

16 years agodebugging off
Faiyaz Ahmed [Thu, 31 Jan 2008 17:09:31 +0000 (17:09 +0000)]
debugging off

16 years agofixed syntax error and added sanity checking.
Faiyaz Ahmed [Thu, 24 Jan 2008 20:48:21 +0000 (20:48 +0000)]
fixed syntax error and added sanity checking.

16 years agoproposed fix for spurious emails when admins set node caps. Also fix for keeping...
Faiyaz Ahmed [Wed, 23 Jan 2008 22:32:28 +0000 (22:32 +0000)]
proposed fix for spurious emails when admins set node caps.  Also fix for keeping persistent slice information for delegated slices.  Should work with regular slices too...

16 years agocan't kill processes in other contexts.
Faiyaz Ahmed [Tue, 22 Jan 2008 20:59:58 +0000 (20:59 +0000)]
can't kill processes in other contexts.

16 years agos/cpu_min/cpu_pct/g
Faiyaz Ahmed [Tue, 22 Jan 2008 20:46:00 +0000 (20:46 +0000)]
s/cpu_min/cpu_pct/g

16 years agothe full version number includes taglevel already
Thierry Parmentelat [Tue, 22 Jan 2008 15:41:18 +0000 (15:41 +0000)]
the full version number includes taglevel already

16 years agoChange cpu_min to cpu_pct to avoid name conflict with attributes affecting rlimits
Andy Bavier [Mon, 21 Jan 2008 19:39:20 +0000 (19:39 +0000)]
Change cpu_min to cpu_pct to avoid name conflict with attributes affecting rlimits

16 years agoClean up code for setting rlimits
Andy Bavier [Mon, 21 Jan 2008 19:20:22 +0000 (19:20 +0000)]
Clean up code for setting rlimits

16 years ago"use name instead of id for initscript.
Faiyaz Ahmed [Wed, 16 Jan 2008 22:06:09 +0000 (22:06 +0000)]
"use name instead of id for initscript.

16 years agoChange default CPU share from 32 to 1
Andy Bavier [Wed, 16 Jan 2008 22:03:59 +0000 (22:03 +0000)]
Change default CPU share from 32 to 1

16 years agoRemove start from recreate.
Faiyaz Ahmed [Tue, 15 Jan 2008 21:31:31 +0000 (21:31 +0000)]
Remove start from recreate.

16 years agoSome comments.
Daniel Hokka Zakrisson [Mon, 14 Jan 2008 19:16:16 +0000 (19:16 +0000)]
Some comments.

16 years agounneeded anymore.
Faiyaz Ahmed [Wed, 9 Jan 2008 21:30:03 +0000 (21:30 +0000)]
unneeded anymore.

16 years agoremove duplicate URL entries.
Faiyaz Ahmed [Wed, 9 Jan 2008 20:27:26 +0000 (20:27 +0000)]
remove duplicate URL entries.

16 years agoready for tagging
Thierry Parmentelat [Tue, 8 Jan 2008 11:49:43 +0000 (11:49 +0000)]
ready for tagging
reviewed URLs and %{plrelease}

16 years ago(no commit message)
Faiyaz Ahmed [Thu, 3 Jan 2008 19:48:17 +0000 (19:48 +0000)]

16 years agoTo be added to all modules.
Faiyaz Ahmed [Thu, 3 Jan 2008 19:45:57 +0000 (19:45 +0000)]
To be added to all modules.

16 years agos/plc_initscript_id/initscript
Faiyaz Ahmed [Thu, 20 Dec 2007 21:59:33 +0000 (21:59 +0000)]
s/plc_initscript_id/initscript
The attribute name used in the API changed and nm was never updated.  Thanks Amine & Thierry.

16 years agoi give up.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:33:15 +0000 (18:33 +0000)]
i give up.

16 years agoPropset.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:06:38 +0000 (18:06 +0000)]
Propset.

16 years agoURL fix.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:02:39 +0000 (18:02 +0000)]
URL fix.

16 years agoUpdated url.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:02:05 +0000 (18:02 +0000)]
Updated url.

16 years agoIf API can't be contacted, let modules bootstrap when applicable.
Faiyaz Ahmed [Mon, 17 Dec 2007 22:23:06 +0000 (22:23 +0000)]
If API can't be contacted, let modules bootstrap when applicable.

16 years agoAdding a check to verify that the environment is not the BOOTCD will prevent a
Stephen Soltesz [Thu, 13 Dec 2007 19:14:58 +0000 (19:14 +0000)]
Adding a check to verify that the environment is not the BOOTCD will prevent a
NodeUpdate from starting the NM.  I think NM starting in the boot cd may be
causing some of the rpmdb corruption seen in /vservers/

16 years agomissing module.
Faiyaz Ahmed [Wed, 12 Dec 2007 21:19:53 +0000 (21:19 +0000)]
missing module.

16 years agoprotect against, and log unknown user or group
Thierry Parmentelat [Wed, 12 Dec 2007 15:43:35 +0000 (15:43 +0000)]
protect against, and log unknown user or group

16 years agofix logging of vserver class into /var/log/nm
Thierry Parmentelat [Wed, 12 Dec 2007 15:13:35 +0000 (15:13 +0000)]
fix logging of vserver class into /var/log/nm

16 years agologging support in vserver.py
Thierry Parmentelat [Wed, 12 Dec 2007 12:09:47 +0000 (12:09 +0000)]
logging support in vserver.py

16 years agoadd a --module option for testing one module at a time
Thierry Parmentelat [Wed, 12 Dec 2007 10:43:24 +0000 (10:43 +0000)]
add a --module option for testing one module at a time

16 years agoApparently this is needed for a sliver to use networking.
Faiyaz Ahmed [Tue, 11 Dec 2007 20:47:30 +0000 (20:47 +0000)]
Apparently this is needed for a sliver to use networking.

16 years agocheck indenting. set ip if ip exists. Probably for vini or related projects. NOT...
Faiyaz Ahmed [Tue, 11 Dec 2007 19:53:36 +0000 (19:53 +0000)]
check indenting.  set ip if ip exists.  Probably for vini or related projects.  NOT for production nodes to worry about...yet.

16 years agodisplay version at startup
Thierry Parmentelat [Tue, 11 Dec 2007 14:58:03 +0000 (14:58 +0000)]
display version at startup

16 years agoreverting initial indentation as per Daniel warning
Thierry Parmentelat [Tue, 11 Dec 2007 14:56:53 +0000 (14:56 +0000)]
reverting initial indentation as per Daniel warning

16 years agovarious cosmetic changes
Thierry Parmentelat [Tue, 11 Dec 2007 12:02:46 +0000 (12:02 +0000)]
various cosmetic changes

NOTE.
I'm leaving vsliver_vs.py untouched
However, in set_resources, most of the calls to the lower level (vserver/vserverimpl)
methods are called unprotected by a try/except
If any of this fails, then the exception gets caught in accounts:_run only
and this might prevent correct operations
to make things worse, in such a case the error messages printed by vserverimpl
might get lost in daemon mode
So a cleanup in this area might be most useful

16 years agomisplaced indentation - caused set_resources to bail out as deep as accounts:_run
Thierry Parmentelat [Tue, 11 Dec 2007 11:51:55 +0000 (11:51 +0000)]
misplaced indentation - caused set_resources to bail out as deep as accounts:_run

16 years agothis error in log_exc caused most of the interesting logs to get just trashed
Thierry Parmentelat [Tue, 11 Dec 2007 08:38:14 +0000 (08:38 +0000)]
this error in log_exc caused most of the interesting logs to get just trashed

16 years ago(*) basically no operational change
Thierry Parmentelat [Mon, 10 Dec 2007 17:25:43 +0000 (17:25 +0000)]
(*) basically no operational change

(*) fix initscript
- was using only first item in OPTIONS
  so only -d was used despite   do_start ${OPTIONS-"-d -s"}
- idem & worse when OPTIONS were set in /etc/sysconfig/NodeManager

btw. it is confusing that the chkconfig name is nm
     while /etc/sysconfig/NodeManager is sourced

(*) add -v option
- allows to log stuff that uses logger.verbose - see below
- stores a pretty printed version of the latest GetSlivers in
  /var/log/get_slivers.txt

(*) actual period was period + random[1..301] with 301 hardwired
    fixed --period (never used because of the above) and added --random

(*) logger now supports logger.verbose and logger.log_slivers

(*) so bottom line is, use e.g. following settings for debugging
# cat /etc/sysconfig/NodeManager
OPTIONS="-d -s --period 60 --random 15 -v"

16 years agoInstall iptables module.
Daniel Hokka Zakrisson [Fri, 7 Dec 2007 15:36:37 +0000 (15:36 +0000)]
Install iptables module.

16 years agoHardcoding names is ugly enough. Don't care about case.
Daniel Hokka Zakrisson [Wed, 5 Dec 2007 19:07:02 +0000 (19:07 +0000)]
Hardcoding names is ugly enough. Don't care about case.

16 years agoDon't mess with the blacklist, it's handled elsewhere.
Daniel Hokka Zakrisson [Tue, 4 Dec 2007 22:52:15 +0000 (22:52 +0000)]
Don't mess with the blacklist, it's handled elsewhere.

16 years agoSupport NAT/port forwards.
Daniel Hokka Zakrisson [Tue, 4 Dec 2007 22:41:31 +0000 (22:41 +0000)]
Support NAT/port forwards.

16 years agoindentation fixed
Thierry Parmentelat [Fri, 30 Nov 2007 09:31:50 +0000 (09:31 +0000)]
indentation fixed

16 years agotabs != 5 spaces
Faiyaz Ahmed [Wed, 21 Nov 2007 15:36:42 +0000 (15:36 +0000)]
tabs != 5 spaces

16 years agoAdded ReCreate. Also added try catch to api eval of rpc method.
Faiyaz Ahmed [Wed, 21 Nov 2007 14:41:17 +0000 (14:41 +0000)]
Added ReCreate.  Also added try catch to api eval of rpc method.

16 years agoIn case the API isn't installed, skip docbook stuffs.
Faiyaz Ahmed [Wed, 14 Nov 2007 03:08:20 +0000 (03:08 +0000)]
In case the API isn't installed, skip docbook stuffs.

16 years agoadd target tags
Thierry Parmentelat [Mon, 12 Nov 2007 13:42:09 +0000 (13:42 +0000)]
add target tags

16 years agoWhile building bootstrapfs on fc6, I'm getting this
Thierry Parmentelat [Mon, 12 Nov 2007 13:40:48 +0000 (13:40 +0000)]
While building bootstrapfs on fc6, I'm getting this

^M  Installing: NodeManager                  ##################### [114/119]Stopping Node Manager: [FAILED]^M
can not change context: migrate kernel feature missing and 'compat' API disabled: Function not implemented
Starting Node Manager: Traceback (most recent call last):
  File "/usr/share/NodeManager/nm.py", line 13, in ?
    import logger
  File "/usr/share/NodeManager/logger.py", line 32
    if name:
             ^
IndentationError: unindent does not match any outer indentation level
[FAILED]^M

16 years agolog slice name where applicable before traceback.
Faiyaz Ahmed [Wed, 7 Nov 2007 22:09:32 +0000 (22:09 +0000)]
log slice name where applicable before traceback.

16 years agoIf no name is specified, just print the traceback.
Faiyaz Ahmed [Wed, 7 Nov 2007 21:59:03 +0000 (21:59 +0000)]
If no name is specified, just print the traceback.

16 years agoAdd more info to tracebacks. Echos slice name before traceback.
Faiyaz Ahmed [Wed, 7 Nov 2007 21:44:33 +0000 (21:44 +0000)]
Add more info to tracebacks.  Echos slice name before traceback.

16 years agoAdded debugging code. Will log slice name when threads die.
Faiyaz Ahmed [Wed, 7 Nov 2007 04:31:55 +0000 (04:31 +0000)]
Added debugging code.  Will log slice name when threads die.

16 years agoCLean up deaddb.
Faiyaz Ahmed [Tue, 6 Nov 2007 19:53:47 +0000 (19:53 +0000)]
CLean up deaddb.

16 years agoForgot case where NM is reinstalled and dat is deleted. Re-init slices, update limit...
Faiyaz Ahmed [Thu, 1 Nov 2007 18:56:53 +0000 (18:56 +0000)]
Forgot case where NM is reinstalled and dat is deleted.  Re-init slices, update limits, then add to dat.

16 years agoSupport for persistent byte limits for dynamic slices. [ticket:19 Ticket]
Faiyaz Ahmed [Wed, 31 Oct 2007 20:48:37 +0000 (20:48 +0000)]
Support for persistent byte limits for dynamic slices. [ticket:19 Ticket]

16 years agoAdded an example of opening ssh within python using popen()
Stephen Soltesz [Tue, 30 Oct 2007 18:17:39 +0000 (18:17 +0000)]
Added an example of opening ssh within python using popen()

16 years agoNMAPI.xml now includes a section including and example using the nm-controller
Stephen Soltesz [Tue, 30 Oct 2007 18:10:48 +0000 (18:10 +0000)]
NMAPI.xml now includes a section including and example using the nm-controller
and the xml-rpc forwarding over the SSH stub account.

The make file uses awk the strip out the unnecessary parts of the html for
upload into Drupal.  out.html is ready for upload.  Would be nice if we could
figure out a 'curl' incantation that would do the post automatically.

16 years agoa typeo prevented the docs from compiling
Stephen Soltesz [Tue, 30 Oct 2007 18:09:21 +0000 (18:09 +0000)]
a typeo prevented the docs from compiling

16 years agoTo support persistent byte totals in case of dynamic slices. Slice data is kept...
Faiyaz Ahmed [Thu, 25 Oct 2007 21:18:41 +0000 (21:18 +0000)]
To support persistent byte totals in case of dynamic slices.  Slice data is kept through duration of recording period in case slice is to reappear.

16 years agoA few tweaks.
Stephen Soltesz [Thu, 25 Oct 2007 18:05:17 +0000 (18:05 +0000)]
A few tweaks.

16 years agoSplit api_calls.py and api.py to make the documentation of the XMLRPC calls
Stephen Soltesz [Thu, 25 Oct 2007 17:49:11 +0000 (17:49 +0000)]
Split api_calls.py and api.py to make the documentation of the XMLRPC calls
easier.

TODO: need to add ReCreate() back to the api.  According to David, it was
lost.

TODO: test that these changes do not break the running operation of NM.

16 years agoTake the new doc out of the branch and into trunk
Stephen Soltesz [Thu, 25 Oct 2007 16:49:32 +0000 (16:49 +0000)]
Take the new doc out of the branch and into trunk

16 years agoTo kill nm procs that are defunct and won't die normall and also to kill nm procs...
Faiyaz Ahmed [Wed, 17 Oct 2007 20:10:20 +0000 (20:10 +0000)]
To kill nm procs that are defunct and won't die normall and also to kill nm procs that are in vservers but won't exit.

16 years agoremove build directory
Faiyaz Ahmed [Wed, 17 Oct 2007 18:22:01 +0000 (18:22 +0000)]
remove build directory