Faiyaz Ahmed [Thu, 26 Feb 2009 16:56:52 +0000 (16:56 +0000)]
Tagging module NodeManager - NodeManager-1.7-44
Delegation code optimization
Fixed some comments
Faiyaz Ahmed [Thu, 26 Feb 2009 16:56:46 +0000 (16:56 +0000)]
Tagging module NodeManager - NodeManager-1.7-44
Delegation code optimization
Fixed some comments
Faiyaz Ahmed [Mon, 16 Feb 2009 20:32:53 +0000 (20:32 +0000)]
* Delegated slivers are refreshed on each epoc from info from PLC. Can be suspended remotely.
* Comments
Faiyaz Ahmed [Mon, 2 Feb 2009 18:49:12 +0000 (18:49 +0000)]
Tagging module NodeManager - NodeManager-1.7-43
BUGFIX: Extra logging was causing the main thread to die when the API was unavailable (which happens nightly due to db cleanup job). Fixed.
Faiyaz Ahmed [Mon, 2 Feb 2009 18:42:14 +0000 (18:42 +0000)]
The logger message was preventing modules from running if/when the API was unavailable.
Faiyaz Ahmed [Fri, 30 Jan 2009 23:51:52 +0000 (23:51 +0000)]
Tagging module NodeManager - NodeManager-1.7-42
* Can add or remove BW limits from PLC w/o reboots.
Faiyaz Ahmed [Fri, 30 Jan 2009 23:50:47 +0000 (23:50 +0000)]
Can add and remove bw accounting without reboots.
Faiyaz Ahmed [Fri, 30 Jan 2009 21:56:05 +0000 (21:56 +0000)]
Tagging module NodeManager - NodeManager-1.7-41
Syntax fix.
Faiyaz Ahmed [Fri, 30 Jan 2009 21:51:33 +0000 (21:51 +0000)]
Syntax error.
Faiyaz Ahmed [Fri, 30 Jan 2009 20:59:34 +0000 (20:59 +0000)]
Make sure the account exists before trying to check if it's running.
Faiyaz Ahmed [Fri, 30 Jan 2009 20:23:15 +0000 (20:23 +0000)]
Tagging module NodeManager - NodeManager-1.7-40
* Ensure RSPEC update on all account types per epoch.
* BUGFIX: HTBs were never being created when default slice's overrides weren'tset.
Faiyaz Ahmed [Fri, 30 Jan 2009 20:20:41 +0000 (20:20 +0000)]
Merge database from trunk. Runs ensure created on every account type.
Fix bug in net where if no overrides, HTBs are never setup.
Faiyaz Ahmed [Thu, 29 Jan 2009 20:54:30 +0000 (20:54 +0000)]
Tagging module NodeManager - NodeManager-1.7-39
Supports disabling of HTBs from PLC.
Faiyaz Ahmed [Thu, 29 Jan 2009 20:34:56 +0000 (20:34 +0000)]
Supports turning off all queuing when the right flag is set.
Faiyaz Ahmed [Thu, 22 Jan 2009 18:42:17 +0000 (18:42 +0000)]
Can disable slice HTB's via PLC_SlICE_PREFIX+_default: sliceattribute net_max_rate=-1
Daniel Hokka Zakrisson [Wed, 3 Dec 2008 17:34:33 +0000 (17:34 +0000)]
Fix typo.
Daniel Hokka Zakrisson [Wed, 3 Dec 2008 16:57:57 +0000 (16:57 +0000)]
Tagging module NodeManager - NodeManager-1.7-38
Add support for plugins.
Move network code to a separate module.
Add AdminTicket API.
Add support for sysctl slice attributes.
Daniel Hokka Zakrisson [Wed, 3 Dec 2008 16:32:52 +0000 (16:32 +0000)]
Use pyplnet.
Daniel Hokka Zakrisson [Tue, 2 Dec 2008 03:44:13 +0000 (03:44 +0000)]
Use codemux condrestart.
Daniel Hokka Zakrisson [Tue, 2 Dec 2008 03:43:10 +0000 (03:43 +0000)]
Fix usage.
Faiyaz Ahmed [Tue, 25 Nov 2008 21:07:04 +0000 (21:07 +0000)]
Revert to previous revisions in branches/1.7/
Faiyaz Ahmed [Tue, 25 Nov 2008 20:52:46 +0000 (20:52 +0000)]
Less noisey, more relevant.
Faiyaz Ahmed [Tue, 25 Nov 2008 20:35:57 +0000 (20:35 +0000)]
Merge from trunk- Includes support for GENI Component wrapper
Faiyaz Ahmed [Tue, 25 Nov 2008 19:30:43 +0000 (19:30 +0000)]
Merge changes that existed in branch concerning slicefamily w/ trunk.
Also changed logging in 1.7 branch to be less noisey.
Removed support for proper.
Daniel Hokka Zakrisson [Mon, 24 Nov 2008 17:09:46 +0000 (17:09 +0000)]
Merge changeset 11123 from the trunk
Marc Fiuczynski [Thu, 20 Nov 2008 14:00:32 +0000 (14:00 +0000)]
Bail more gracefully when "data" from GetSlivers() does not contain
the fields needed by the various Init*() functions.
Marc Fiuczynski [Thu, 13 Nov 2008 22:49:47 +0000 (22:49 +0000)]
modprobe.py:
This new python module implements a class to parse /etc/modprobe.conf
and change/update/add aliases and options. This is generally needed
to support the NodeNetworkSetting for "DRIVER". For now I am
leveraging this to add NIC bonding.
net.py:
Added InitInterfaces() which was originally based on the code found in
the BootManager/source/steps/WriteNetworkConfig.py. My original
motivation was to support "ALIAS" setup dynamically so that one could
assign a slice a separate IP address without needing to reboot the
node.
Added support to more generally handle "CFGOPTIONS", which are the
name=value pairs that are supposed to be dumped into a
/etc/sysconfig/network-scripts/ifcfg-$dev file.
Added support for "DRIVER". This code calls the modprobe
functionality mentioned above.
Added support to let aliases be associated by "IFNAME" rather than
just by "HWADDR". E.g., it is possible to associate an alias with
eth0 rather than having to figure out its explicitl macaddr.
Added suport to add, change, remove
/etc/sysconfig/network-scripts/ifcfg-$dev files and then appropriately
call ifdown and ifup.
Daniel Hokka Zakrisson [Thu, 6 Nov 2008 01:23:52 +0000 (01:23 +0000)]
Indentation and arbitrary sysctls.
Marc Fiuczynski [Wed, 5 Nov 2008 22:17:22 +0000 (22:17 +0000)]
One can now specify "sysctl.x.y" attributes where x.y is a kernel variable.
sm.py searches for these slice attributes and adds them to the rspec.
sliver_vs.py processes these in set_resources(), but only if the new
"setup" argument to set_resources() is set to True. By default
setup=False and should only be set to true when setting up a vserver,
as done in util-vserver-pl/python/vserver.py:__do_chcontext(). The
reason being is that it needs to write /proc/sys/x/y while within the
setup phase of a vserver context when capability checking is disabled.
Faiyaz Ahmed [Tue, 23 Sep 2008 20:34:52 +0000 (20:34 +0000)]
Tagging module NodeManager - NodeManager-1.7-37
Slices are created 1 at a time to avoid race conditions.
Faiyaz Ahmed [Tue, 23 Sep 2008 20:07:18 +0000 (20:07 +0000)]
Only 1 vuseradd will run at a time.
Faiyaz Ahmed [Fri, 19 Sep 2008 19:24:35 +0000 (19:24 +0000)]
Tagging module NodeManager - NodeManager-1.7-36
Internet2 clique flow classification is now setup by NM.
Faiyaz Ahmed [Fri, 19 Sep 2008 19:06:20 +0000 (19:06 +0000)]
Check for the existence of the Internet2 clique iptables rule and add if absent.
Faiyaz Ahmed [Wed, 17 Sep 2008 18:25:59 +0000 (18:25 +0000)]
Tagging module NodeManager - NodeManager-1.7-35
Clique network shares don't exist. Removed from bwmon.
Faiyaz Ahmed [Wed, 17 Sep 2008 18:24:34 +0000 (18:24 +0000)]
Clique network shares don't exist yet.
Faiyaz Ahmed [Fri, 12 Sep 2008 20:21:38 +0000 (20:21 +0000)]
Tagging module NodeManager - NodeManager-1.7-34
* Fixed slice restart via xmlrpc to actually set resources
* Reverted bwmon to check current min/max limits before manipulating HTB.
Faiyaz Ahmed [Fri, 12 Sep 2008 20:12:03 +0000 (20:12 +0000)]
enable pl_Mom's bw monitor.
Faiyaz Ahmed [Wed, 10 Sep 2008 20:34:33 +0000 (20:34 +0000)]
Move checks from bwmon for running limits before calling bwlimit.
Faiyaz Ahmed [Tue, 9 Sep 2008 16:47:50 +0000 (16:47 +0000)]
* Explicitly run configure, which sets capabilities and resources, before starting vserver.
* Print username when NM api returns permission denied.
Faiyaz Ahmed [Wed, 3 Sep 2008 21:01:01 +0000 (21:01 +0000)]
kluge until packet tagging works again. DO NOT TAGsvn diff
Faiyaz Ahmed [Wed, 3 Sep 2008 20:56:17 +0000 (20:56 +0000)]
Tagging module NodeManager - NodeManager-1.7-33
bwmon now has enable/disable flag to control throttling.
Faiyaz Ahmed [Wed, 3 Sep 2008 20:48:57 +0000 (20:48 +0000)]
Added ENABLE flag to disable throttling.
Thierry Parmentelat [Mon, 1 Sep 2008 12:36:02 +0000 (12:36 +0000)]
Tagging module NodeManager - NodeManager-1.7-32
always log message when expected vserver reference is missing
Thierry Parmentelat [Mon, 1 Sep 2008 10:31:24 +0000 (10:31 +0000)]
promote serious log messages
Faiyaz Ahmed [Mon, 25 Aug 2008 20:46:11 +0000 (20:46 +0000)]
Tagging module NodeManager - NodeManager-1.7-31
Emails were only being sent of high bandwidth caps were being exceeded. Fixed.
Faiyaz Ahmed [Mon, 25 Aug 2008 20:44:33 +0000 (20:44 +0000)]
Emails were only being sent if high bandwidth caps were exceeded. Fixed.
Faiyaz Ahmed [Thu, 21 Aug 2008 18:47:05 +0000 (18:47 +0000)]
Tagging module NodeManager - NodeManager-1.7-30
bwmon: Only mention the limit the slice went over. Not both it and the second limit.
Faiyaz Ahmed [Thu, 21 Aug 2008 16:43:29 +0000 (16:43 +0000)]
bwmon: Fixed extra notification when 1 of 2 limits weren't exceeded.
Faiyaz Ahmed [Thu, 21 Aug 2008 02:46:14 +0000 (02:46 +0000)]
Tagging module NodeManager - NodeManager-1.7-29
Fixed KeyError in logging.
Faiyaz Ahmed [Thu, 21 Aug 2008 02:44:54 +0000 (02:44 +0000)]
Fixed KeyError in logging
Daniel Hokka Zakrisson [Thu, 21 Aug 2008 01:23:24 +0000 (01:23 +0000)]
If the kernel doesn't have support for fuse, exit nicely.
Faiyaz Ahmed [Wed, 20 Aug 2008 23:40:44 +0000 (23:40 +0000)]
Tagging module NodeManager - NodeManager-1.7-28
Fixed syntax error in notify function call. Also fixed values in email message and logging.
Faiyaz Ahmed [Wed, 20 Aug 2008 23:36:41 +0000 (23:36 +0000)]
Syntax error in notify function call. Also fixed logging.
Daniel Hokka Zakrisson [Sun, 17 Aug 2008 22:43:49 +0000 (22:43 +0000)]
Tagging module NodeManager - NodeManager-1.7-27
Fix the FUSE initscript.
Daniel Hokka Zakrisson [Sun, 17 Aug 2008 22:40:53 +0000 (22:40 +0000)]
Expand the glob.
Daniel Hokka Zakrisson [Sat, 16 Aug 2008 23:04:29 +0000 (23:04 +0000)]
Tagging module NodeManager - NodeManager-1.7-26
FUSE support.
Thierry Parmentelat [Thu, 14 Aug 2008 06:00:30 +0000 (06:00 +0000)]
fix build
Daniel Hokka Zakrisson [Wed, 13 Aug 2008 15:42:13 +0000 (15:42 +0000)]
FUSE patch from Jeremy Stribling.
Faiyaz Ahmed [Wed, 13 Aug 2008 14:34:45 +0000 (14:34 +0000)]
Tagging module NodeManager - NodeManager-1.7-25
Removed thread created for each sliver (!!!).
Slivers now spawned out of main thread.
This closes the Delegation bug and closes the recent rash of NM instabilities due to queue overflows. [ticket: 384]
Faiyaz Ahmed [Tue, 12 Aug 2008 19:02:59 +0000 (19:02 +0000)]
Threads with queues using global timers for throttling execution rates are a BAD IDEAsvn diff
Faiyaz Ahmed [Tue, 12 Aug 2008 03:36:45 +0000 (03:36 +0000)]
Bound queue so they don't grow without bound.
Faiyaz Ahmed [Fri, 1 Aug 2008 18:35:25 +0000 (18:35 +0000)]
Tagging module NodeManager - NodeManager-1.7-24
* Update bandwidth related attributes on every NM sync. Bwlimit will check if values have changed.
* Vsys supports local_ scripts and NM will disregard them.
Faiyaz Ahmed [Fri, 1 Aug 2008 18:29:05 +0000 (18:29 +0000)]
Get defaults from bwlimit. Also remove checks before issuing bwlimit commands. Bwlimit now checks running values before committing new ones. This should fix the share/bwmin updates from Sirius loans.
Faiyaz Ahmed [Fri, 1 Aug 2008 16:36:28 +0000 (16:36 +0000)]
Support for local_ scripts
Faiyaz Ahmed [Mon, 28 Jul 2008 20:13:21 +0000 (20:13 +0000)]
Tagging module NodeManager - NodeManager-1.7-23
After removing the fork() to the slice's uid when writing .ssh/authorized_keys, .ssh had the wrong owner/group. Fixed.
Faiyaz Ahmed [Mon, 28 Jul 2008 19:43:57 +0000 (19:43 +0000)]
Chown .ssh to user:slices. SSH will bail otherwise.
Faiyaz Ahmed [Sat, 26 Jul 2008 02:51:12 +0000 (02:51 +0000)]
Tagging module NodeManager - NodeManager-1.7-22
Small change. Change uid to slice owner of authorized_keys.
Faiyaz Ahmed [Sat, 26 Jul 2008 02:49:30 +0000 (02:49 +0000)]
Change ownership of authorized_keys after writing
Faiyaz Ahmed [Wed, 23 Jul 2008 15:51:57 +0000 (15:51 +0000)]
Tagging module NodeManager - NodeManager-1.7-21
Slices with initscripts kept restarting. Fixed.
Also removed unnecessary fork just to write .ssh/authorized keys for every slice.
Faiyaz Ahmed [Tue, 22 Jul 2008 22:32:01 +0000 (22:32 +0000)]
* Slices w/ initscripts were starting repeatedly because the flag that signals the initscript has not changed was being toggled after the fork(). Fixed.
Faiyaz Ahmed [Tue, 22 Jul 2008 15:45:01 +0000 (15:45 +0000)]
why are we forking here? Removed fork just to write a file.
Faiyaz Ahmed [Tue, 15 Jul 2008 21:25:34 +0000 (21:25 +0000)]
Tagging module NodeManager - NodeManager-1.7-20
* Check slice is_running() every cycle. If not, assume damaged and restart.
Faiyaz Ahmed [Tue, 15 Jul 2008 21:10:56 +0000 (21:10 +0000)]
Added logging. Forgot to return anything; threads would blow up since test of is_runing would fail.
Faiyaz Ahmed [Mon, 14 Jul 2008 22:00:52 +0000 (22:00 +0000)]
Add check to see if sliver is_running() during ensure_created. Previously, if the object existed in the database, it was assumed the sliver was running and the start() operation would ignore the record. However, if a sliver is damaged, its best to query util-vserver to actually make sure the slice is indeed running.
Daniel Hokka Zakrisson [Mon, 7 Jul 2008 16:22:57 +0000 (16:22 +0000)]
Tagging module NodeManager - NodeManager-1.7-19
chrooting is not thread-safe.
Daniel Hokka Zakrisson [Mon, 7 Jul 2008 16:13:12 +0000 (16:13 +0000)]
Use the right variable.
Daniel Hokka Zakrisson [Mon, 7 Jul 2008 15:58:24 +0000 (15:58 +0000)]
chrooting is not thread-safe. Install the initscript before calling VServer.start instead, where we know we're the only thread running.
Faiyaz Ahmed [Fri, 27 Jun 2008 17:32:13 +0000 (17:32 +0000)]
Tagging module NodeManager - NodeManager-1.7-18
Log disk init AFTER acquiring disk semaphore.
Faiyaz Ahmed [Fri, 27 Jun 2008 16:48:20 +0000 (16:48 +0000)]
Print log only after global vdu semaphore is acquired. Misleading otherwise.
Thierry Parmentelat [Wed, 25 Jun 2008 09:09:58 +0000 (09:09 +0000)]
Tagging module NodeManager - NodeManager-1.7-17
unconditionnally passes node_id and slicefamily to conf_file scripts
correctly set personality a sliver creation time (not yet used by util-vserver-pl though)
Thierry Parmentelat [Wed, 25 Jun 2008 08:55:42 +0000 (08:55 +0000)]
passes slicefamily unconditionnaly, as for node_id
Thierry Parmentelat [Wed, 25 Jun 2008 08:49:22 +0000 (08:49 +0000)]
enable & fix keyword expansion
Thierry Parmentelat [Wed, 25 Jun 2008 08:17:57 +0000 (08:17 +0000)]
conf_files has support for @SLICEFAMILY@ in sources
new functions for reading node's arch, node_id and the like have moved in tools.py
Thierry Parmentelat [Tue, 24 Jun 2008 16:12:40 +0000 (16:12 +0000)]
cross-module change for 4.2
- NodeManager/conf_files set node_id when invoking source URL
- nodeconfig/yum.conf.php : no functional change, but uses node_id to gather nodegroups and displays them in comments
Thierry Parmentelat [Tue, 24 Jun 2008 07:43:06 +0000 (07:43 +0000)]
set personality for slivers with a different arch
Stephen Soltesz [Thu, 19 Jun 2008 19:13:58 +0000 (19:13 +0000)]
Tagging module NodeManager - NodeManager-1.7-16
enables a vsys slice attribute to end with 'a', 'c', or 'l' characters without
NM going bonkers.
Stephen Soltesz [Thu, 19 Jun 2008 19:12:02 +0000 (19:12 +0000)]
Stupidest bug in history.
rstrip is a character oriented function, that nukes all characters in the
argument, therefore, an attribute named "comon_exec.acl" will strip all the
right most, 'a', 'c', 'l', and '.' characters. The result is 'comon_exe' b/c
of the trailing 'c'.
Ugg.
Stephen Soltesz [Wed, 18 Jun 2008 19:29:40 +0000 (19:29 +0000)]
Tagging module NodeManager - NodeManager-1.7-15
enable restart if vsys.conf changes also.
Stephen Soltesz [Wed, 18 Jun 2008 19:01:11 +0000 (19:01 +0000)]
also set vsys to restart when the vsys.conf file is re-written.
this avoids the vsys update, which may wipe out the current /etc/vsys.conf
file, from keeping vsys dysfunctional forever. Previously, vsys never would
have been restarted.
Stephen Soltesz [Wed, 18 Jun 2008 17:31:10 +0000 (17:31 +0000)]
Tagging module NodeManager - NodeManager-1.7-14
the _restart flag for vsys was getting lost when looking across multiple
vservers. adding the 'or' should preserve any 'True' returns from
createVsysDir()
Stephen Soltesz [Wed, 18 Jun 2008 17:18:16 +0000 (17:18 +0000)]
the _restart value was being reset when subsequent slices weren't yet created.
the result was that vsys was not being restarted when it should be.
Faiyaz Ahmed [Tue, 17 Jun 2008 20:09:58 +0000 (20:09 +0000)]
Tagging module NodeManager - NodeManager-1.7-13
Time out curl when no response for 90 seconds.
Faiyaz Ahmed [Tue, 17 Jun 2008 18:47:22 +0000 (18:47 +0000)]
Timeout curl in the event Apache (PLC side) opens the XMLRPC session, but returns no data for specified timeout.
Stephen Soltesz [Fri, 13 Jun 2008 22:03:34 +0000 (22:03 +0000)]
Tagging module NodeManager - NodeManager-1.7-12
Patch designed to work around the vsys-fail-to-restart problem with
non-existent directories, and the vuseradd-fail-to-work on directories that
do exist.
This patch will work in conjunction with the new vsys patch.
Stephen Soltesz [Fri, 13 Jun 2008 21:57:42 +0000 (21:57 +0000)]
patch to not create the /vservers/slicename/vsys directory until vuseradd has
created /vservers/slicename, then report the difference so that vsys can be
restarted even if the configuration files have not been movidifed.
Restarting vsys will ensure that it re-reads the config file. The preferred
long-term solution is for vsys to auto-read it's config files using the
same/similar inotify mechanism used on the pipes.
Thierry Parmentelat [Mon, 9 Jun 2008 15:24:29 +0000 (15:24 +0000)]
taglevel on the 1.7-11 tag had remained 10 - also moving the trunk to 1.8-0 as 1.7 is confusing
Faiyaz Ahmed [Wed, 4 Jun 2008 20:43:00 +0000 (20:43 +0000)]
Log when talking to PLC.
Faiyaz Ahmed [Wed, 4 Jun 2008 20:10:54 +0000 (20:10 +0000)]
Don't wait for vserver to be running before starting vsys on slice.
Faiyaz Ahmed [Wed, 4 Jun 2008 19:59:57 +0000 (19:59 +0000)]
Removed proper.
Thierry Parmentelat [Wed, 14 May 2008 12:53:55 +0000 (12:53 +0000)]
Tagging module NodeManager - NodeManager-1.7-10
fixed doc build by locating locally installed DTDs at build-time