nodemanager.git
14 years agoSetting tag NodeManager-1.8-8 NodeManager-1.8-8
Faiyaz Ahmed [Mon, 3 Aug 2009 20:57:47 +0000 (20:57 +0000)]
Setting tag NodeManager-1.8-8
Generalized plugins
Fixed initscript start up bug.

14 years agoSetting tag NodeManager-1.8-8
Faiyaz Ahmed [Mon, 3 Aug 2009 20:57:44 +0000 (20:57 +0000)]
Setting tag NodeManager-1.8-8
Generalized plugins
Fixed initscript start up bug.

14 years agoRearranging and moving trunk to 1.8.
Faiyaz Ahmed [Mon, 3 Aug 2009 20:55:38 +0000 (20:55 +0000)]
Rearranging and moving trunk to 1.8.

14 years agoNM does not fork often. A stack limit is now unnecessary.
Faiyaz Ahmed [Mon, 3 Aug 2009 20:45:56 +0000 (20:45 +0000)]
NM does not fork often.  A stack limit is now unnecessary.
This fixes the crond bug inside slivers.

14 years agocleanup: use os.path.join
Marc Fiuczynski [Tue, 21 Jul 2009 18:50:24 +0000 (18:50 +0000)]
cleanup: use os.path.join

14 years agoTabs vs. spaces.
Daniel Hokka Zakrisson [Mon, 20 Jul 2009 23:28:12 +0000 (23:28 +0000)]
Tabs vs. spaces.

14 years agouse a temp file to write the keys
Marc Fiuczynski [Fri, 17 Jul 2009 04:05:35 +0000 (04:05 +0000)]
use a temp file to write the keys

14 years agoonly copy in the /dev/sd* file if its not there
Marc Fiuczynski [Fri, 17 Jul 2009 04:04:01 +0000 (04:04 +0000)]
only copy in the /dev/sd* file if its not there

14 years agoNodeManager plugin to empower slivers to make API calls.
Marc Fiuczynski [Thu, 16 Jul 2009 21:23:49 +0000 (21:23 +0000)]
NodeManager plugin to empower slivers to make API calls.

14 years agoNodeManager plugin to support mapping unused raw disks into a slice
Marc Fiuczynski [Thu, 16 Jul 2009 21:23:14 +0000 (21:23 +0000)]
NodeManager plugin to support mapping unused raw disks into a slice
that has the rawdisk sliver tag.

14 years agoNM plugin to pull down special account keys: specifically site_admin and root
Marc Fiuczynski [Thu, 16 Jul 2009 19:53:42 +0000 (19:53 +0000)]
NM plugin to pull down special account keys: specifically site_admin and root

14 years agoNeed to use , rather than / as the sed separator
Marc Fiuczynski [Wed, 15 Jul 2009 13:35:12 +0000 (13:35 +0000)]
Need to use , rather than / as the sed separator

14 years agoSyntax error in overrides
Faiyaz Ahmed [Tue, 14 Jul 2009 18:21:45 +0000 (18:21 +0000)]
Syntax error in overrides

14 years agosync up with what's on the branch
Marc Fiuczynski [Thu, 9 Jul 2009 02:27:34 +0000 (02:27 +0000)]
sync up with what's on the branch

14 years agoas a plugin, be more verbose about when they are started
Marc Fiuczynski [Tue, 7 Jul 2009 22:00:38 +0000 (22:00 +0000)]
as a plugin, be more verbose about when they are started

14 years ago- change so that NodeManager/plugins are always loaded, as that's
Marc Fiuczynski [Tue, 7 Jul 2009 21:58:00 +0000 (21:58 +0000)]
- change so that NodeManager/plugins are always loaded, as that's
  where codemux & vsys live

14 years agonet.py is a 'required' 'plugin' module similar to conf_files.py, bwmon.py, and sm.py
Marc Fiuczynski [Tue, 7 Jul 2009 21:50:08 +0000 (21:50 +0000)]
net.py is a 'required' 'plugin' module similar to conf_files.py, bwmon.py, and sm.py

14 years agoChange local GetSlivers() callbacks to take args as (plc,data,config)
Marc Fiuczynski [Tue, 7 Jul 2009 21:10:06 +0000 (21:10 +0000)]
Change local GetSlivers() callbacks to take args as (plc,data,config)

14 years ago- turn net.py into a NM plugin and move to plugin directory
Marc Fiuczynski [Tue, 7 Jul 2009 20:32:36 +0000 (20:32 +0000)]
- turn net.py into a NM plugin and move to plugin directory
- pass plc, data, and config to each plugin

14 years agoCall to get whole record, not just tags.
Faiyaz Ahmed [Mon, 6 Jul 2009 21:13:18 +0000 (21:13 +0000)]
Call to get whole record, not just tags.

14 years agoGet slice tags from within sliver using nm api.
Faiyaz Ahmed [Mon, 6 Jul 2009 16:37:40 +0000 (16:37 +0000)]
Get slice tags from within sliver using nm api.

14 years ago* give all modules access to the API and to the config class
Faiyaz Ahmed [Mon, 29 Jun 2009 20:48:28 +0000 (20:48 +0000)]
* give all modules access to the API and to the config class
* Fix delegation
* codemux can be disabled using the _default slice

14 years agoRerun start up scripts after re-enable.
Faiyaz Ahmed [Fri, 26 Jun 2009 18:33:58 +0000 (18:33 +0000)]
Rerun start up scripts after re-enable.

14 years agoUpdated bw limits
Faiyaz Ahmed [Thu, 4 Jun 2009 18:59:53 +0000 (18:59 +0000)]
Updated bw limits

14 years agoDouble bw limits.
Faiyaz Ahmed [Mon, 1 Jun 2009 20:12:40 +0000 (20:12 +0000)]
Double bw limits.

14 years agoattributes are now tagnames. Also move debugging output to statements before places...
Faiyaz Ahmed [Tue, 26 May 2009 18:46:00 +0000 (18:46 +0000)]
attributes are now tagnames.  Also move debugging output to statements before places where data is used.

14 years agoclean up .ssh/authorized_keys setup for slices
Marc Fiuczynski [Wed, 20 May 2009 13:24:38 +0000 (13:24 +0000)]
clean up .ssh/authorized_keys setup for slices

15 years agoguard AuthCheck with try/except as it will raise an exception.
Barış Metin [Mon, 6 Apr 2009 10:18:22 +0000 (10:18 +0000)]
guard AuthCheck with try/except as it will raise an exception.

15 years agoif authentication with the session fails try authenticating with hmac
Barış Metin [Mon, 6 Apr 2009 09:46:34 +0000 (09:46 +0000)]
if authentication with the session fails try authenticating with hmac
to get a new session.

15 years agoUse log_call instead of os.system().
Faiyaz Ahmed [Wed, 1 Apr 2009 17:44:55 +0000 (17:44 +0000)]
Use log_call instead of os.system().

15 years agochange from call()/check_call to Popen() in log_exec. This will raise and log an...
Faiyaz Ahmed [Fri, 27 Mar 2009 19:50:29 +0000 (19:50 +0000)]
change from call()/check_call to Popen() in log_exec.  This will raise and log an exception when spawned processes barf.  nm.daemon should now be empty :-D

15 years agoBranch 1.9 for module NodeManager created (as new trunk) from tag NodeManager-1.8-1
Faiyaz Ahmed [Tue, 24 Mar 2009 21:25:09 +0000 (21:25 +0000)]
Branch 1.9 for module NodeManager created (as new trunk) from tag NodeManager-1.8-1

15 years agoTagging module NodeManager - NodeManager-1.8-1
Faiyaz Ahmed [Tue, 24 Mar 2009 21:24:40 +0000 (21:24 +0000)]
Tagging module NodeManager - NodeManager-1.8-1

15 years agoMerge from Branch.
Faiyaz Ahmed [Tue, 24 Mar 2009 19:47:07 +0000 (19:47 +0000)]
Merge from Branch.

15 years agoMerge from branch.
Faiyaz Ahmed [Mon, 16 Feb 2009 20:14:44 +0000 (20:14 +0000)]
Merge from branch.
*  Changes delegate class to controller
*  Adds ability to disable HTBs
*  fixes bug in nm.py when API is unavailable.
*  adds sysctl slice attribute

15 years agoCan disable slice HTB's via PLC_SlICE_PREFIX+_default: sliceattribute net_max_rate=-1
Faiyaz Ahmed [Thu, 22 Jan 2009 18:42:17 +0000 (18:42 +0000)]
Can disable slice HTB's via PLC_SlICE_PREFIX+_default: sliceattribute net_max_rate=-1

15 years agoalways store latest data from GetSlivers in /var/log/getslivers.txt, not only when...
Thierry Parmentelat [Mon, 15 Dec 2008 13:05:23 +0000 (13:05 +0000)]
always store latest data from GetSlivers in /var/log/getslivers.txt, not only when verbose

15 years agoUse pyplnet.
Daniel Hokka Zakrisson [Wed, 3 Dec 2008 17:36:30 +0000 (17:36 +0000)]
Use pyplnet.

15 years agoUse codemux condrestart.
Daniel Hokka Zakrisson [Tue, 2 Dec 2008 03:44:49 +0000 (03:44 +0000)]
Use codemux condrestart.

15 years agorenaming SliceAttribute into SliceTag and InterfaceSetting into InterfaceTag
Thierry Parmentelat [Fri, 28 Nov 2008 14:36:02 +0000 (14:36 +0000)]
renaming SliceAttribute into SliceTag and InterfaceSetting into InterfaceTag

15 years agoMerge changes that existed only in the branch.
Faiyaz Ahmed [Thu, 27 Nov 2008 22:19:56 +0000 (22:19 +0000)]
Merge changes that existed only in the branch.

15 years agoMerge changes that existed in branch concerning slicefamily w/ trunk.
Faiyaz Ahmed [Tue, 25 Nov 2008 19:30:43 +0000 (19:30 +0000)]
Merge changes that existed in branch concerning slicefamily w/ trunk.
Also changed logging in 1.7 branch to be less noisey.
Removed support for proper.

15 years agoChange logging to be quieter
Faiyaz Ahmed [Tue, 25 Nov 2008 19:27:37 +0000 (19:27 +0000)]
Change logging to be quieter

15 years agofix build
Thierry Parmentelat [Sat, 22 Nov 2008 08:42:14 +0000 (08:42 +0000)]
fix build

15 years agoPlugins directory.
Faiyaz Ahmed [Fri, 21 Nov 2008 21:32:53 +0000 (21:32 +0000)]
Plugins directory.

15 years agoThe proper module no longer exists.
Daniel Hokka Zakrisson [Fri, 21 Nov 2008 15:51:57 +0000 (15:51 +0000)]
The proper module no longer exists.

15 years agoVerbose logging. \nMoved semaphore out of worker class.
Faiyaz Ahmed [Tue, 18 Nov 2008 22:01:14 +0000 (22:01 +0000)]
Verbose logging. \nMoved semaphore out of worker class.

15 years agoAdded method to verify if controller account is setup.
Faiyaz Ahmed [Tue, 18 Nov 2008 21:58:48 +0000 (21:58 +0000)]
Added method to verify if controller account is setup.

15 years agoEnsure delegated slivers have their info synced with PLC after ticket is delivered.
Faiyaz Ahmed [Tue, 18 Nov 2008 21:58:25 +0000 (21:58 +0000)]
Ensure delegated slivers have their info synced with PLC after ticket is delivered.

15 years agochanged nm controller type.
Faiyaz Ahmed [Tue, 18 Nov 2008 19:35:05 +0000 (19:35 +0000)]
changed nm controller type.

15 years agomerge changes to set_resources() from branch to trunk
Marc Fiuczynski [Mon, 17 Nov 2008 16:51:56 +0000 (16:51 +0000)]
merge changes to set_resources() from branch to trunk

15 years agoChange to Controller from Delegate shell
Faiyaz Ahmed [Fri, 14 Nov 2008 22:11:18 +0000 (22:11 +0000)]
Change to Controller from Delegate shell

15 years agoNM-controller accounts != delegate accounts. Nomenclature change. purely cosmetic.
Faiyaz Ahmed [Fri, 14 Nov 2008 21:16:05 +0000 (21:16 +0000)]
NM-controller accounts != delegate accounts.  Nomenclature change.  purely cosmetic.

15 years agoSlices can call recreate on themselves regardless of instantiation.
Faiyaz Ahmed [Wed, 12 Nov 2008 21:05:31 +0000 (21:05 +0000)]
Slices can call recreate on themselves regardless of instantiation.
Calling create/destroy on a PLC slice results in an error.
White space changes.

15 years agoReCreate is NOT an anonymous call.
Faiyaz Ahmed [Wed, 12 Nov 2008 19:19:20 +0000 (19:19 +0000)]
ReCreate is NOT an anonymous call.

15 years agoSyntax error in permission checking for genicw.
Faiyaz Ahmed [Tue, 11 Nov 2008 22:23:05 +0000 (22:23 +0000)]
Syntax error in permission checking for genicw.

15 years agobug in matching MAC addr with nodenetworks mac addr.
Faiyaz Ahmed [Mon, 10 Nov 2008 20:45:25 +0000 (20:45 +0000)]
bug in matching MAC addr with nodenetworks mac addr.

15 years agoKeep rspecs for delegated slices in sync w/ PLC
Faiyaz Ahmed [Mon, 10 Nov 2008 19:00:28 +0000 (19:00 +0000)]
Keep rspecs for delegated slices in sync w/ PLC

15 years agoRough draft to support admin tickets from "blessed" interfaces.
Faiyaz Ahmed [Thu, 6 Nov 2008 22:26:03 +0000 (22:26 +0000)]
Rough draft to support admin tickets from "blessed" interfaces.

15 years agoSyntax error
Faiyaz Ahmed [Wed, 8 Oct 2008 14:55:42 +0000 (14:55 +0000)]
Syntax error

15 years agoUntested
Faiyaz Ahmed [Mon, 6 Oct 2008 16:29:14 +0000 (16:29 +0000)]
Untested

15 years agoAnother optimization. Bringing us closer to generic support for cliques
Faiyaz Ahmed [Mon, 22 Sep 2008 17:41:50 +0000 (17:41 +0000)]
Another optimization. Bringing us closer to generic support for cliques

15 years agoCheck for the existence of the Internet2 clique iptables rule and add if absent.
Faiyaz Ahmed [Fri, 19 Sep 2008 19:06:20 +0000 (19:06 +0000)]
Check for the existence of the Internet2 clique iptables rule and add if absent.

15 years agoClique network shares don't exist yet.
Faiyaz Ahmed [Wed, 17 Sep 2008 18:24:34 +0000 (18:24 +0000)]
Clique network shares don't exist yet.

15 years agoMove checks from bwmon for running limits before calling bwlimit.
Faiyaz Ahmed [Wed, 10 Sep 2008 20:34:33 +0000 (20:34 +0000)]
Move checks from bwmon for running limits before calling bwlimit.

15 years ago* Explicitly run configure, which sets capabilities and resources, before starting...
Faiyaz Ahmed [Tue, 9 Sep 2008 16:47:50 +0000 (16:47 +0000)]
* Explicitly run configure, which sets capabilities and resources, before starting vserver.
* Print username when NM api returns permission denied.

15 years agoenable disable flag.
Faiyaz Ahmed [Wed, 3 Sep 2008 20:57:20 +0000 (20:57 +0000)]
enable disable flag.

15 years agofrom branch
Thierry Parmentelat [Mon, 1 Sep 2008 15:04:27 +0000 (15:04 +0000)]
from branch

15 years agoFix toggling of email flag.
Faiyaz Ahmed [Mon, 25 Aug 2008 19:03:35 +0000 (19:03 +0000)]
Fix toggling of email flag.

15 years agobwmon: Fixed extra notification when 1 of 2 limits weren't exceeded.
Faiyaz Ahmed [Thu, 21 Aug 2008 16:43:10 +0000 (16:43 +0000)]
bwmon: Fixed extra notification when 1 of 2 limits weren't exceeded.

15 years agoFixed key error in logging.
Faiyaz Ahmed [Thu, 21 Aug 2008 02:44:20 +0000 (02:44 +0000)]
Fixed key error in logging.

15 years agoIf the kernel doesn't have support for fuse, exit nicely.
Daniel Hokka Zakrisson [Thu, 21 Aug 2008 01:23:47 +0000 (01:23 +0000)]
If the kernel doesn't have support for fuse, exit nicely.

15 years agoclean up message template and logging. syntax errors.
Faiyaz Ahmed [Wed, 20 Aug 2008 23:33:32 +0000 (23:33 +0000)]
clean up message template and logging.  syntax errors.

15 years agosyntax error. fixed.
Faiyaz Ahmed [Wed, 20 Aug 2008 23:20:30 +0000 (23:20 +0000)]
syntax error.  fixed.

15 years agosyntax error. fixed.
Faiyaz Ahmed [Wed, 20 Aug 2008 23:14:56 +0000 (23:14 +0000)]
syntax error.  fixed.

15 years agotext.
Faiyaz Ahmed [Mon, 18 Aug 2008 19:27:14 +0000 (19:27 +0000)]
text.

15 years agoExpand the glob.
Daniel Hokka Zakrisson [Sun, 17 Aug 2008 22:41:37 +0000 (22:41 +0000)]
Expand the glob.

15 years agofix build
Thierry Parmentelat [Thu, 14 Aug 2008 06:00:30 +0000 (06:00 +0000)]
fix build

15 years agoFUSE patch from Jeremy Stribling.
Daniel Hokka Zakrisson [Wed, 13 Aug 2008 15:45:55 +0000 (15:45 +0000)]
FUSE patch from Jeremy Stribling.

15 years agoRound to ints
Faiyaz Ahmed [Tue, 12 Aug 2008 19:16:58 +0000 (19:16 +0000)]
Round to ints

15 years agoThreads with queues using global timers for throttling execution rates are a BAD...
Faiyaz Ahmed [Tue, 12 Aug 2008 19:02:37 +0000 (19:02 +0000)]
Threads with queues using global timers for throttling execution rates are a BAD IDEAsvn diff

15 years agoNM has a worker thread for every sliver ever to exist on the node. Each thread works...
Faiyaz Ahmed [Mon, 11 Aug 2008 18:34:45 +0000 (18:34 +0000)]
NM has a worker thread for every sliver ever to exist on the node.  Each thread works off of a queue where the database adds a state from the statemachine to execute.  To keep from spawning upwards of 300 worker processes during start(), a cummulative global delay is incremented (by 2) for every sliver known to the db.  After the delay, start() is run.  But, it's possible for the delay to grow without bound when NM is resynced to PLC and the db adds previously added states to the queue and causing the cumm start delay to be incremented once again.  This patch keeps the queue from growing beyond the 4 known states.  Any other additions are likely repeates and don't need to be added again.  This is a bandaid;  really we should keep a table of what exists in the queue and keep from readding while also bounding the delay to some maximum over the number of slivers present on the node.

15 years ago2 way merge from branch. Includes support for local_ scripts.
Faiyaz Ahmed [Fri, 1 Aug 2008 16:36:00 +0000 (16:36 +0000)]
2 way merge from branch.  Includes support for local_ scripts.

15 years agoGet defaults from bwlimit. Also remove checks before issuing bwlimit commands. ...
Faiyaz Ahmed [Fri, 1 Aug 2008 16:10:49 +0000 (16:10 +0000)]
Get defaults from bwlimit.  Also remove checks before issuing bwlimit commands.  Bwlimit now checks running values before committing new ones.

15 years agoChown .ssh to user:slices. SSH will bail otherwise.
Faiyaz Ahmed [Mon, 28 Jul 2008 19:45:40 +0000 (19:45 +0000)]
Chown .ssh to user:slices.  SSH will bail otherwise.

15 years agochange ownership of authorized_keys.
Faiyaz Ahmed [Sat, 26 Jul 2008 02:47:44 +0000 (02:47 +0000)]
change ownership of authorized_keys.

15 years ago* Slices w/ initscripts were starting repeatedly because the flag that signals the...
Faiyaz Ahmed [Tue, 22 Jul 2008 22:35:37 +0000 (22:35 +0000)]
* Slices w/ initscripts were starting repeatedly because the flag that signals the initscript has not changed was being toggled after the fork().  Fixed.

15 years agoThere's no need to fork to write to a file.
Faiyaz Ahmed [Mon, 21 Jul 2008 23:55:39 +0000 (23:55 +0000)]
There's no need to fork to write to a file.

15 years agoAdded logging. Forgot to return anything; threads would blow up since test of is_ru...
Faiyaz Ahmed [Tue, 15 Jul 2008 21:10:56 +0000 (21:10 +0000)]
Added logging.  Forgot to return anything;  threads would blow up since test of is_runing would fail.

15 years agoAdd check to see if sliver is_running() during ensure_created. Previously, if the...
Faiyaz Ahmed [Mon, 14 Jul 2008 22:00:52 +0000 (22:00 +0000)]
Add check to see if sliver is_running() during ensure_created.  Previously, if the object existed in the database, it was assumed the sliver was running and the start() operation would ignore the record.  However, if a sliver is damaged, its best to query util-vserver to actually make sure the slice is indeed running.

15 years agoDisregard scripts that start with "local_".
Faiyaz Ahmed [Tue, 8 Jul 2008 17:46:08 +0000 (17:46 +0000)]
Disregard scripts that start with "local_".

15 years agoUse the right variable.
Daniel Hokka Zakrisson [Mon, 7 Jul 2008 16:13:22 +0000 (16:13 +0000)]
Use the right variable.

15 years agochrooting is not thread-safe. Install the initscript before calling VServer.start...
Daniel Hokka Zakrisson [Mon, 7 Jul 2008 16:02:42 +0000 (16:02 +0000)]
chrooting is not thread-safe. Install the initscript before calling VServer.start instead, where we know we're the only thread running.

15 years agoPrint log only after global vdu semaphore is acquired. Misleading otherwise.
Faiyaz Ahmed [Fri, 27 Jun 2008 16:46:12 +0000 (16:46 +0000)]
Print log only after global vdu semaphore is acquired.  Misleading otherwise.

15 years agoapplied changeset 9676 on trunk
Thierry Parmentelat [Tue, 24 Jun 2008 07:46:18 +0000 (07:46 +0000)]
applied changeset 9676 on trunk

15 years agothis is what i really wanted to do. temporary fix. this needs to be cleaned up
Faiyaz Ahmed [Fri, 20 Jun 2008 01:17:40 +0000 (01:17 +0000)]
this is what i really wanted to do.  temporary fix.  this needs to be cleaned up

15 years agoShould be able to explicitly specify as well.
Faiyaz Ahmed [Fri, 20 Jun 2008 00:58:03 +0000 (00:58 +0000)]
Should be able to explicitly specify as well.

15 years agoTimeout curl in the event Apache (PLC side) opens the XMLRPC session, but returns...
Faiyaz Ahmed [Tue, 17 Jun 2008 18:47:22 +0000 (18:47 +0000)]
Timeout curl in the event Apache (PLC side) opens the XMLRPC session, but returns no data for specified timeout.

15 years ago5 minutes is too long of a timeout to keep an apache proc open on PLC. 90 seconds...
Faiyaz Ahmed [Tue, 17 Jun 2008 18:43:49 +0000 (18:43 +0000)]
5 minutes is too long of a timeout to keep an apache proc open on PLC.  90 seconds is probably more than enough.

15 years agofor exception handling.
Faiyaz Ahmed [Tue, 17 Jun 2008 18:40:45 +0000 (18:40 +0000)]
for exception handling.