nodemanager.git
15 years agoTagging module NodeManager - NodeManager-1.7-9 NodeManager-1.7-9
Faiyaz Ahmed [Fri, 9 May 2008 21:24:51 +0000 (21:24 +0000)]
Tagging module NodeManager - NodeManager-1.7-9
* Reverted vserver start to forking before VServer.start to avoid defunct procs.* House keeping in various places.

15 years agoTagging module NodeManager - NodeManager-1.7-9
Faiyaz Ahmed [Fri, 9 May 2008 21:24:48 +0000 (21:24 +0000)]
Tagging module NodeManager - NodeManager-1.7-9
* Reverted vserver start to forking before VServer.start to avoid defunct procs.* House keeping in various places.

15 years ago* Avoids defunct procs
Faiyaz Ahmed [Fri, 9 May 2008 21:21:39 +0000 (21:21 +0000)]
* Avoids defunct procs
* generalized architecture vserver reference code.

15 years agoTagging module NodeManager - NodeManager-1.7-8
Thierry Parmentelat [Fri, 9 May 2008 11:42:13 +0000 (11:42 +0000)]
Tagging module NodeManager - NodeManager-1.7-8
merge changes for myplc-docs from trunk

15 years agonm branch : merge changesets 9269 and 9278
Thierry Parmentelat [Fri, 9 May 2008 11:40:34 +0000 (11:40 +0000)]
nm branch : merge changesets 9269 and 9278

16 years agoTagging module NodeManager - NodeManager-1.7-7
Faiyaz Ahmed [Wed, 16 Apr 2008 21:31:48 +0000 (21:31 +0000)]
Tagging module NodeManager - NodeManager-1.7-7

Set vcVHI_CONTEXT as slice_id for fprobe-ulog to mark packets with.

16 years agosetname as part of set_resources. Better than stupid sleep while part of start(...
Faiyaz Ahmed [Wed, 16 Apr 2008 21:26:57 +0000 (21:26 +0000)]
setname as part of set_resources.  Better than stupid sleep while part of start().  Called from VServer.__do_chcontext().

16 years agoSet name to slice_id during start.
Faiyaz Ahmed [Wed, 16 Apr 2008 20:49:51 +0000 (20:49 +0000)]
Set name to slice_id during start.
Removed extra fork during start.

16 years agoTagging module NodeManager - NodeManager-1.7-6
Faiyaz Ahmed [Wed, 9 Apr 2008 19:08:08 +0000 (19:08 +0000)]
Tagging module NodeManager - NodeManager-1.7-6

* Codemux will use PLC_API_HOST when PLC_PLANETFLOW_HOST isn't defined.

16 years agoBW limits and resources are handled by bwmon.py
Faiyaz Ahmed [Wed, 9 Apr 2008 19:01:02 +0000 (19:01 +0000)]
BW limits and resources are handled by bwmon.py

16 years agoUse API host when Planetflow host isn't defined.
Faiyaz Ahmed [Wed, 9 Apr 2008 19:00:48 +0000 (19:00 +0000)]
Use API host when Planetflow host isn't defined.

16 years agoTagging module NodeManager - NodeManager-1.7-5
Faiyaz Ahmed [Fri, 4 Apr 2008 20:00:49 +0000 (20:00 +0000)]
Tagging module NodeManager - NodeManager-1.7-5
* vdu limitting when NM restarts and slices are re-init'ed
* CoDemux config parser update.  Now tolerates spaces.

16 years agoFile locking isn't exclusive in the same process across threads. Switched to regular...
Faiyaz Ahmed [Fri, 4 Apr 2008 19:54:58 +0000 (19:54 +0000)]
File locking isn't exclusive in the same process across threads.  Switched to regular semaphores.  The assumption is sliver_vs.configure is called before Vserver.start(), which sets disk_usage_initialized.  The disk check should be skipped during start, so the lock won't carry over.  ...I hope.

16 years agoFix config file parsing. Blank lines were messing thigns up.
Faiyaz Ahmed [Thu, 3 Apr 2008 22:15:41 +0000 (22:15 +0000)]
Fix config file parsing.  Blank lines were messing thigns up.

16 years agoFixed api deliver_ticket bug.
Faiyaz Ahmed [Wed, 2 Apr 2008 21:15:36 +0000 (21:15 +0000)]
Fixed api deliver_ticket bug.

16 years agoUpdated changelog
Faiyaz Ahmed [Wed, 2 Apr 2008 21:13:21 +0000 (21:13 +0000)]
Updated changelog

16 years agoAdded support for multiple host -> same slice mappings
Faiyaz Ahmed [Wed, 2 Apr 2008 19:14:09 +0000 (19:14 +0000)]
Added support for multiple host -> same slice mappings

16 years agoBump revision.
Faiyaz Ahmed [Tue, 1 Apr 2008 21:47:59 +0000 (21:47 +0000)]
Bump revision.

16 years agoSyntax error when writing config file
Faiyaz Ahmed [Tue, 1 Apr 2008 21:39:50 +0000 (21:39 +0000)]
Syntax error when writing config file

16 years agoupdated changelog.
Faiyaz Ahmed [Fri, 28 Mar 2008 19:18:26 +0000 (19:18 +0000)]
updated changelog.

16 years agoBump versions
Faiyaz Ahmed [Fri, 28 Mar 2008 17:50:54 +0000 (17:50 +0000)]
Bump versions

16 years agoLatest branch.
Faiyaz Ahmed [Fri, 28 Mar 2008 17:20:11 +0000 (17:20 +0000)]
Latest branch.

16 years agoget config from file.
Faiyaz Ahmed [Thu, 27 Mar 2008 20:34:26 +0000 (20:34 +0000)]
get config from file.

16 years agosort domain name. lower order domains should be first.
Faiyaz Ahmed [Thu, 27 Mar 2008 19:17:51 +0000 (19:17 +0000)]
sort domain name.  lower order domains should be first.

16 years agoroot slice needs to come first. Also, emtpy conf file now handled correctly.
Faiyaz Ahmed [Tue, 25 Mar 2008 19:21:16 +0000 (19:21 +0000)]
root slice needs to come first.  Also, emtpy conf file now handled correctly.

16 years ago* Checks for zombied pids during restart
Faiyaz Ahmed [Tue, 25 Mar 2008 17:35:01 +0000 (17:35 +0000)]
*  Checks for zombied pids during restart
*  Fixed toggling of instantiated slices.

16 years agoadd carriage return to lines
Faiyaz Ahmed [Mon, 24 Mar 2008 21:41:20 +0000 (21:41 +0000)]
add carriage return to lines

16 years agoAdded codemux
Faiyaz Ahmed [Mon, 24 Mar 2008 21:30:00 +0000 (21:30 +0000)]
Added codemux

16 years ago* Now callback in NM by default
Faiyaz Ahmed [Mon, 24 Mar 2008 21:29:32 +0000 (21:29 +0000)]
* Now callback in NM by default
* Clean up after slice is removed

16 years agopath fix.
Faiyaz Ahmed [Mon, 24 Mar 2008 21:00:32 +0000 (21:00 +0000)]
path fix.

16 years agoInitial Commit.
Faiyaz Ahmed [Mon, 24 Mar 2008 20:00:59 +0000 (20:00 +0000)]
Initial Commit.

16 years agoInitial commit.
Faiyaz Ahmed [Mon, 24 Mar 2008 19:50:38 +0000 (19:50 +0000)]
Initial commit.

16 years agomultiple slice falvours - second iteration
Thierry Parmentelat [Sat, 22 Mar 2008 11:03:45 +0000 (11:03 +0000)]
multiple slice falvours - second iteration
* review naming scheme for system slices; now planetflow vref image is named like
  planetflow-f8-i386 for consistency
* use for sensible name for the stamp where default slicefamily is stored

16 years agofixed a couple remaining issues, seems to work
Thierry Parmentelat [Fri, 21 Mar 2008 21:09:39 +0000 (21:09 +0000)]
fixed a couple remaining issues, seems to work

16 years agofixed syntax error
Thierry Parmentelat [Fri, 21 Mar 2008 20:55:48 +0000 (20:55 +0000)]
fixed syntax error

16 years agoCheck to see if slice is running first before creating /vsys directory.
Faiyaz Ahmed [Fri, 21 Mar 2008 18:27:10 +0000 (18:27 +0000)]
Check to see if slice is running first before creating /vsys directory.

16 years agosupport for multiple slice reference images
Thierry Parmentelat [Fri, 21 Mar 2008 16:35:32 +0000 (16:35 +0000)]
support for multiple slice reference images

* vserver-reference rpm names have changed and become
    vserver-@pldistro@-@fcdistro@-@arch@
    vserver-systemslices-@pldistro@-@fcdistro@-@arch@

* this contains the images located as
   /vservers/.vref/@pldistro@-@fcdistro@-@arch@
and
  /vservers/.vstub/@pldistro@-@fcdistro@-@arch@/planetflow
respectively

* a stamp gets created on the nodes as /etc/planetlab/defaultvref
  that contains the name for the default slicefamily to use

* nodemanager tries to be smart when chosing the right argument to pass to vuseradd
  for this purpose, the argument in 'vref' is taken as a dash-separated list of 'wishes'
  so e.g. is defaultvref is planetlab-f8-x86_64, then we should find for the image name:
vref=i386           -> vuseradd -t planetlab-f8-i386
vref=centos5        -> vuseradd -t planetlab-centos5-x86_64
vref=planetflow     -> vuseradd -t planetflow
vref=centos5-onelab -> vuseradd -t onelab-centos5-x86_64

for legacy reasons, if the stamp is not found, 'default' is taken instead

=== status
* this is only partly tested
* a given node can install several variants of vserver-*
  this would require a manual upload of the rpms into the right install-rpms
  and manual changes in yumgroups.
* next improvement would be to have the system (planetflow) slices have a smarter naming scheme as well
  this way a 'planetflow' vref would rather be rewritten as planetflow-f8-x86_64
  for the time being it is not supported to install several variants of vserver-systemslices
  on the node - although it should be harmless

16 years agoBug fix for caching dead slices.
Faiyaz Ahmed [Fri, 7 Mar 2008 22:24:31 +0000 (22:24 +0000)]
Bug fix for caching dead slices.

16 years agoLess noisey logging. Also uses LOG_LEVEL now.
Faiyaz Ahmed [Fri, 7 Mar 2008 20:34:59 +0000 (20:34 +0000)]
Less noisey logging.  Also uses LOG_LEVEL now.

16 years agofixed deletion logic. ..this is sloppy but it works. Also fixed network shares.
Faiyaz Ahmed [Thu, 6 Mar 2008 22:06:13 +0000 (22:06 +0000)]
fixed deletion logic.  ..this is sloppy but it works.  Also fixed network shares.

16 years agoto support pl_mom list emails instead of mails to support
Faiyaz Ahmed [Thu, 6 Mar 2008 16:01:56 +0000 (16:01 +0000)]
to support pl_mom list emails instead of mails to support

16 years agosimple patch for redirecting pl-mom notification to the right mailing list
John Doe [Wed, 5 Mar 2008 09:43:05 +0000 (09:43 +0000)]
simple patch for redirecting pl-mom notification to the right mailing list

16 years agoAdded code to reduce duplicate entries in /etc/vsys.conf; this will help play
Stephen Soltesz [Tue, 4 Mar 2008 19:26:17 +0000 (19:26 +0000)]
Added code to reduce duplicate entries in /etc/vsys.conf; this will help play
more nicely with vsys.

16 years agoAdded stuff for the NM API.
Stephen Soltesz [Fri, 29 Feb 2008 19:27:55 +0000 (19:27 +0000)]
Added stuff for the NM API.

16 years agoScript to automatically upload changes in a drupal page to drupal. Handy for
Stephen Soltesz [Fri, 29 Feb 2008 19:27:12 +0000 (19:27 +0000)]
Script to automatically upload changes in a drupal page to drupal.  Handy for
the api.  This almost works, but not quite.  It worked on a recent myplc, but doesn't
work on the production box.  I don't know why.

16 years agoAdded sharing for loans.
Faiyaz Ahmed [Wed, 27 Feb 2008 14:28:42 +0000 (14:28 +0000)]
Added sharing for loans.

16 years agoConfigures vsys via vsys slice attribute {name: vsys, value: script}
Thierry Parmentelat [Thu, 14 Feb 2008 18:33:10 +0000 (18:33 +0000)]
Configures vsys via vsys slice attribute {name: vsys, value: script}
CPU reservations are now calculated via percentages instead of shares
BW totals preserved for dynamic slices
Closes bug where node cap sets off bw slice alarms for all slices.

Manual fix after a broken module-tag.py attempt

16 years agoInclude vsys.
Faiyaz Ahmed [Wed, 13 Feb 2008 17:25:25 +0000 (17:25 +0000)]
Include vsys.

16 years agoinclude vsys call back.
Faiyaz Ahmed [Wed, 13 Feb 2008 17:24:46 +0000 (17:24 +0000)]
include vsys call back.

16 years agoCleaned up bugs. Now works as advertised.
Faiyaz Ahmed [Wed, 13 Feb 2008 17:15:41 +0000 (17:15 +0000)]
Cleaned up bugs.  Now works as advertised.

16 years agofixed typos.
Faiyaz Ahmed [Mon, 11 Feb 2008 22:35:32 +0000 (22:35 +0000)]
fixed typos.

16 years agoSecure, and configure vsys scripts.
Faiyaz Ahmed [Mon, 11 Feb 2008 21:59:36 +0000 (21:59 +0000)]
Secure, and configure vsys scripts.

16 years agotypo
Faiyaz Ahmed [Thu, 7 Feb 2008 19:50:58 +0000 (19:50 +0000)]
typo

16 years agolong awaited vsys callback. Still in progress.
Faiyaz Ahmed [Wed, 6 Feb 2008 22:05:32 +0000 (22:05 +0000)]
long awaited vsys callback.  Still in progress.

16 years agodebugging off
Faiyaz Ahmed [Thu, 31 Jan 2008 17:09:31 +0000 (17:09 +0000)]
debugging off

16 years agofixed syntax error and added sanity checking.
Faiyaz Ahmed [Thu, 24 Jan 2008 20:48:21 +0000 (20:48 +0000)]
fixed syntax error and added sanity checking.

16 years agoproposed fix for spurious emails when admins set node caps. Also fix for keeping...
Faiyaz Ahmed [Wed, 23 Jan 2008 22:32:28 +0000 (22:32 +0000)]
proposed fix for spurious emails when admins set node caps.  Also fix for keeping persistent slice information for delegated slices.  Should work with regular slices too...

16 years agocan't kill processes in other contexts.
Faiyaz Ahmed [Tue, 22 Jan 2008 20:59:58 +0000 (20:59 +0000)]
can't kill processes in other contexts.

16 years agos/cpu_min/cpu_pct/g
Faiyaz Ahmed [Tue, 22 Jan 2008 20:46:00 +0000 (20:46 +0000)]
s/cpu_min/cpu_pct/g

16 years agothe full version number includes taglevel already
Thierry Parmentelat [Tue, 22 Jan 2008 15:41:18 +0000 (15:41 +0000)]
the full version number includes taglevel already

16 years agoChange cpu_min to cpu_pct to avoid name conflict with attributes affecting rlimits
Andy Bavier [Mon, 21 Jan 2008 19:39:20 +0000 (19:39 +0000)]
Change cpu_min to cpu_pct to avoid name conflict with attributes affecting rlimits

16 years agoClean up code for setting rlimits
Andy Bavier [Mon, 21 Jan 2008 19:20:22 +0000 (19:20 +0000)]
Clean up code for setting rlimits

16 years ago"use name instead of id for initscript.
Faiyaz Ahmed [Wed, 16 Jan 2008 22:06:09 +0000 (22:06 +0000)]
"use name instead of id for initscript.

16 years agoChange default CPU share from 32 to 1
Andy Bavier [Wed, 16 Jan 2008 22:03:59 +0000 (22:03 +0000)]
Change default CPU share from 32 to 1

16 years agoRemove start from recreate.
Faiyaz Ahmed [Tue, 15 Jan 2008 21:31:31 +0000 (21:31 +0000)]
Remove start from recreate.

16 years agoSome comments.
Daniel Hokka Zakrisson [Mon, 14 Jan 2008 19:16:16 +0000 (19:16 +0000)]
Some comments.

16 years agounneeded anymore.
Faiyaz Ahmed [Wed, 9 Jan 2008 21:30:03 +0000 (21:30 +0000)]
unneeded anymore.

16 years agoremove duplicate URL entries.
Faiyaz Ahmed [Wed, 9 Jan 2008 20:27:26 +0000 (20:27 +0000)]
remove duplicate URL entries.

16 years agoready for tagging
Thierry Parmentelat [Tue, 8 Jan 2008 11:49:43 +0000 (11:49 +0000)]
ready for tagging
reviewed URLs and %{plrelease}

16 years ago(no commit message)
Faiyaz Ahmed [Thu, 3 Jan 2008 19:48:17 +0000 (19:48 +0000)]

16 years agoTo be added to all modules.
Faiyaz Ahmed [Thu, 3 Jan 2008 19:45:57 +0000 (19:45 +0000)]
To be added to all modules.

16 years agos/plc_initscript_id/initscript
Faiyaz Ahmed [Thu, 20 Dec 2007 21:59:33 +0000 (21:59 +0000)]
s/plc_initscript_id/initscript
The attribute name used in the API changed and nm was never updated.  Thanks Amine & Thierry.

16 years agoi give up.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:33:15 +0000 (18:33 +0000)]
i give up.

16 years agoPropset.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:06:38 +0000 (18:06 +0000)]
Propset.

16 years agoURL fix.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:02:39 +0000 (18:02 +0000)]
URL fix.

16 years agoUpdated url.
Faiyaz Ahmed [Thu, 20 Dec 2007 18:02:05 +0000 (18:02 +0000)]
Updated url.

16 years agoIf API can't be contacted, let modules bootstrap when applicable.
Faiyaz Ahmed [Mon, 17 Dec 2007 22:23:06 +0000 (22:23 +0000)]
If API can't be contacted, let modules bootstrap when applicable.

16 years agoAdding a check to verify that the environment is not the BOOTCD will prevent a
Stephen Soltesz [Thu, 13 Dec 2007 19:14:58 +0000 (19:14 +0000)]
Adding a check to verify that the environment is not the BOOTCD will prevent a
NodeUpdate from starting the NM.  I think NM starting in the boot cd may be
causing some of the rpmdb corruption seen in /vservers/

16 years agomissing module.
Faiyaz Ahmed [Wed, 12 Dec 2007 21:19:53 +0000 (21:19 +0000)]
missing module.

16 years agoprotect against, and log unknown user or group
Thierry Parmentelat [Wed, 12 Dec 2007 15:43:35 +0000 (15:43 +0000)]
protect against, and log unknown user or group

16 years agofix logging of vserver class into /var/log/nm
Thierry Parmentelat [Wed, 12 Dec 2007 15:13:35 +0000 (15:13 +0000)]
fix logging of vserver class into /var/log/nm

16 years agologging support in vserver.py
Thierry Parmentelat [Wed, 12 Dec 2007 12:09:47 +0000 (12:09 +0000)]
logging support in vserver.py

16 years agoadd a --module option for testing one module at a time
Thierry Parmentelat [Wed, 12 Dec 2007 10:43:24 +0000 (10:43 +0000)]
add a --module option for testing one module at a time

16 years agoApparently this is needed for a sliver to use networking.
Faiyaz Ahmed [Tue, 11 Dec 2007 20:47:30 +0000 (20:47 +0000)]
Apparently this is needed for a sliver to use networking.

16 years agocheck indenting. set ip if ip exists. Probably for vini or related projects. NOT...
Faiyaz Ahmed [Tue, 11 Dec 2007 19:53:36 +0000 (19:53 +0000)]
check indenting.  set ip if ip exists.  Probably for vini or related projects.  NOT for production nodes to worry about...yet.

16 years agodisplay version at startup
Thierry Parmentelat [Tue, 11 Dec 2007 14:58:03 +0000 (14:58 +0000)]
display version at startup

16 years agoreverting initial indentation as per Daniel warning
Thierry Parmentelat [Tue, 11 Dec 2007 14:56:53 +0000 (14:56 +0000)]
reverting initial indentation as per Daniel warning

16 years agovarious cosmetic changes
Thierry Parmentelat [Tue, 11 Dec 2007 12:02:46 +0000 (12:02 +0000)]
various cosmetic changes

NOTE.
I'm leaving vsliver_vs.py untouched
However, in set_resources, most of the calls to the lower level (vserver/vserverimpl)
methods are called unprotected by a try/except
If any of this fails, then the exception gets caught in accounts:_run only
and this might prevent correct operations
to make things worse, in such a case the error messages printed by vserverimpl
might get lost in daemon mode
So a cleanup in this area might be most useful

16 years agomisplaced indentation - caused set_resources to bail out as deep as accounts:_run
Thierry Parmentelat [Tue, 11 Dec 2007 11:51:55 +0000 (11:51 +0000)]
misplaced indentation - caused set_resources to bail out as deep as accounts:_run

16 years agothis error in log_exc caused most of the interesting logs to get just trashed
Thierry Parmentelat [Tue, 11 Dec 2007 08:38:14 +0000 (08:38 +0000)]
this error in log_exc caused most of the interesting logs to get just trashed

16 years ago(*) basically no operational change
Thierry Parmentelat [Mon, 10 Dec 2007 17:25:43 +0000 (17:25 +0000)]
(*) basically no operational change

(*) fix initscript
- was using only first item in OPTIONS
  so only -d was used despite   do_start ${OPTIONS-"-d -s"}
- idem & worse when OPTIONS were set in /etc/sysconfig/NodeManager

btw. it is confusing that the chkconfig name is nm
     while /etc/sysconfig/NodeManager is sourced

(*) add -v option
- allows to log stuff that uses logger.verbose - see below
- stores a pretty printed version of the latest GetSlivers in
  /var/log/get_slivers.txt

(*) actual period was period + random[1..301] with 301 hardwired
    fixed --period (never used because of the above) and added --random

(*) logger now supports logger.verbose and logger.log_slivers

(*) so bottom line is, use e.g. following settings for debugging
# cat /etc/sysconfig/NodeManager
OPTIONS="-d -s --period 60 --random 15 -v"

16 years agoInstall iptables module.
Daniel Hokka Zakrisson [Fri, 7 Dec 2007 15:36:37 +0000 (15:36 +0000)]
Install iptables module.

16 years agoHardcoding names is ugly enough. Don't care about case.
Daniel Hokka Zakrisson [Wed, 5 Dec 2007 19:07:02 +0000 (19:07 +0000)]
Hardcoding names is ugly enough. Don't care about case.

16 years agoDon't mess with the blacklist, it's handled elsewhere.
Daniel Hokka Zakrisson [Tue, 4 Dec 2007 22:52:15 +0000 (22:52 +0000)]
Don't mess with the blacklist, it's handled elsewhere.

16 years agoSupport NAT/port forwards.
Daniel Hokka Zakrisson [Tue, 4 Dec 2007 22:41:31 +0000 (22:41 +0000)]
Support NAT/port forwards.

16 years agoindentation fixed
Thierry Parmentelat [Fri, 30 Nov 2007 09:31:50 +0000 (09:31 +0000)]
indentation fixed

16 years agotabs != 5 spaces
Faiyaz Ahmed [Wed, 21 Nov 2007 15:36:42 +0000 (15:36 +0000)]
tabs != 5 spaces

16 years agoAdded ReCreate. Also added try catch to api eval of rpc method.
Faiyaz Ahmed [Wed, 21 Nov 2007 14:41:17 +0000 (14:41 +0000)]
Added ReCreate.  Also added try catch to api eval of rpc method.

16 years agoIn case the API isn't installed, skip docbook stuffs.
Faiyaz Ahmed [Wed, 14 Nov 2007 03:08:20 +0000 (03:08 +0000)]
In case the API isn't installed, skip docbook stuffs.

16 years agoadd target tags
Thierry Parmentelat [Mon, 12 Nov 2007 13:42:09 +0000 (13:42 +0000)]
add target tags