nodemanager.git
12 years agoSetting tag nodemanager-2.1-1 nodemanager-2.1-1
Thierry Parmentelat [Fri, 13 Apr 2012 14:32:46 +0000 (16:32 +0200)]
Setting tag nodemanager-2.1-1
first working draft for dealing with libvirt/lxc on f16 nodes
not expected to work with mainline nodes (use 2.0 for that for now)

12 years agofix comments about requires in specfile
Thierry Parmentelat [Fri, 13 Apr 2012 09:46:29 +0000 (11:46 +0200)]
fix comments about requires in specfile

12 years agobump release number
Thierry Parmentelat [Fri, 30 Mar 2012 07:12:43 +0000 (09:12 +0200)]
bump release number

12 years agoremove xml template
Thierry Parmentelat [Fri, 13 Apr 2012 09:20:24 +0000 (11:20 +0200)]
remove xml template
currently the code uses the one that comes with sliceimage (which is
not identical), and this file is not packaged anyway
it would definitely make sense to move if back in this module at some
further point

12 years agolook for the xml template under 2 names so the lxc-reference packaging
Thierry Parmentelat [Thu, 12 Apr 2012 08:23:23 +0000 (10:23 +0200)]
look for the xml template under 2 names so the lxc-reference packaging
might still be used for now

12 years agorevert change n-1 : restore order for xml initialization
Thierry Parmentelat [Thu, 12 Apr 2012 08:11:14 +0000 (10:11 +0200)]
revert change n-1 : restore order for xml initialization

12 years agomore consistent naming for xml template
Thierry Parmentelat [Wed, 11 Apr 2012 22:05:01 +0000 (00:05 +0200)]
more consistent naming for xml template

12 years agocheck for the xml template first thing, show filename if missing
Thierry Parmentelat [Wed, 11 Apr 2012 21:54:18 +0000 (23:54 +0200)]
check for the xml template first thing, show filename if missing

12 years agoincrease gravity of error message
Thierry Parmentelat [Wed, 11 Apr 2012 16:09:06 +0000 (18:09 +0200)]
increase gravity of error message

12 years agolog missing path when ref image not found
Thierry Parmentelat [Wed, 11 Apr 2012 16:08:28 +0000 (18:08 +0200)]
log missing path when ref image not found

12 years agoFixes for F16.
Marco Yuen [Mon, 5 Mar 2012 18:37:19 +0000 (13:37 -0500)]
Fixes for F16.

cgroup is now mounted automatcially by systemd and the way is mounted is
very different from before. Hence, cgroups.py needs to be changed to
reflect the new mount point, and it doesn't use inotify to monitor the
FS anymore. Everything is done dynamically at runtime.

Changes for Coresched are cgroups related.

Since /var is mounted on tmpfs, os.rename doesn't work across partition,
so shutil.move is used instead.

12 years agotry to work around ssh prompting for a confirmation when reaching a VM
Thierry Parmentelat [Mon, 20 Feb 2012 16:17:29 +0000 (17:17 +0100)]
try to work around ssh prompting for a confirmation when reaching a VM

12 years agoInstall bwlimit.py to the python site directory.
Marco Yuen [Fri, 13 Jan 2012 15:44:53 +0000 (10:44 -0500)]
Install bwlimit.py to the python site directory.

12 years agoA small bug fix with somem formatting.
Marco Yuen [Fri, 6 Jan 2012 19:32:22 +0000 (14:32 -0500)]
A small bug fix with somem formatting.

In the log output, sys.exe_info wasn't being called, and it was
returning the exception type instead of the exception value.

12 years agoMostly aesthetic changes and fix a bug in codemux.
Marco Yuen [Fri, 6 Jan 2012 17:24:51 +0000 (12:24 -0500)]
Mostly aesthetic changes and fix a bug in codemux.

Remove a bunch of white spaces in the sliver* files. Inside codemux
there is a reference to the vserver module which is installed by
util-vserver; implement a method that uses libvirt to check whether a
LXC domain is running or not.

12 years agoAdd sleep to initscript
Marco Yuen [Wed, 21 Dec 2011 22:46:04 +0000 (17:46 -0500)]
Add sleep to initscript

The sleep is to make sure libvirt has finished initializing otherwise
NodeManager will throw exception.

12 years agoMerge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel
Xavi Leon [Wed, 21 Dec 2011 16:54:14 +0000 (11:54 -0500)]
Merge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel

12 years agoRemoved some references to sliver_vs which crashed nodemanager. Changed the
Xavi Leon [Wed, 21 Dec 2011 16:52:40 +0000 (11:52 -0500)]
Removed some references to sliver_vs which crashed nodemanager. Changed the
default slice type from sliver.VS to sliver.LXC so we don't need to specify it
on myplc

12 years agoAdd more python modules to setup.py.
Marco Yuen [Mon, 19 Dec 2011 20:01:46 +0000 (15:01 -0500)]
Add more python modules to setup.py.

12 years agoChange NodeManager start order to start after libvirt.
Marco Yuen [Fri, 16 Dec 2011 19:05:33 +0000 (14:05 -0500)]
Change NodeManager start order to start after libvirt.

12 years agoRemove vserver dependency
Marco Yuen [Fri, 16 Dec 2011 16:31:25 +0000 (11:31 -0500)]
Remove vserver dependency

12 years agoMerge branch 'master' into lxc_devel
Marco Yuen [Thu, 15 Dec 2011 16:28:05 +0000 (11:28 -0500)]
Merge branch 'master' into lxc_devel

12 years agoFix the 'sshsh' install command.
Marco Yuen [Thu, 15 Dec 2011 16:23:08 +0000 (11:23 -0500)]
Fix the 'sshsh' install command.

12 years agoInstall sshsh to /bin to allow slices to login to the vms through ssh.
Xavi Leon [Wed, 14 Dec 2011 19:24:40 +0000 (14:24 -0500)]
Install sshsh to /bin to allow slices to login to the vms through ssh.

12 years agoSetting tag nodemanager-2.0-34 nodemanager-2.0-34
Thierry Parmentelat [Fri, 9 Dec 2011 07:47:15 +0000 (08:47 +0100)]
Setting tag nodemanager-2.0-34
Added memory scheduling to core scheduler
Core scheduler will now attempt to schedule cores on the same CPU to a slice, if a slice uses multiple cores

12 years agoChange btrfs subvolume default permissions for the guest FS to 755 instead of
Xavi Leon [Thu, 8 Dec 2011 21:15:45 +0000 (16:15 -0500)]
Change btrfs subvolume default permissions for the guest FS to 755 instead of
700 (which prevents regular users to use the guest fs).

12 years agoCgroup common interface. Used by coresched.py and sliver_libvirt.py.
Xavi Leon [Thu, 8 Dec 2011 19:04:39 +0000 (14:04 -0500)]
Cgroup common interface. Used by coresched.py and sliver_libvirt.py.

12 years agoCgroups common interface. Used by sliver_libvirt and coresched.
Xavi Leon [Thu, 8 Dec 2011 19:03:40 +0000 (14:03 -0500)]
Cgroups common interface. Used by sliver_libvirt and coresched.

12 years agoMerge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel
Xavi Leon [Tue, 6 Dec 2011 17:26:34 +0000 (12:26 -0500)]
Merge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel

12 years agoMerge branch 'master' into lxc_devel lxcbuild
Marco Yuen [Tue, 6 Dec 2011 17:22:02 +0000 (12:22 -0500)]
Merge branch 'master' into lxc_devel

12 years agoRefactor code. Put ebtables stuff at sliver creation time (start/stop) on
Xavi Leon [Fri, 2 Dec 2011 20:47:02 +0000 (15:47 -0500)]
Refactor code. Put ebtables stuff at sliver creation time (start/stop) on
sliver_libvirt.py

12 years agoAdded ability to filter and classify packets based on the containers interface.
Xavi Leon [Fri, 2 Dec 2011 17:50:16 +0000 (12:50 -0500)]
Added ability to filter and classify packets based on the containers interface.
Changes:
- lxc libvirt configuration template to attach the xid to the container
  interface
- added ebtables rule to mark packets going out from the containers interface
  with its xid and added a filter to classify packets based on this mark
- moved the definition of container after the user is created so we get the
  correct xid to attach to the virtual interface name.

12 years agoPatch to get the type of virtualization based on type tag. This way, we can get
Xavi Leon [Fri, 2 Dec 2011 17:49:10 +0000 (12:49 -0500)]
Patch to get the type of virtualization based on type tag. This way, we can get
the correct directory in cgroups.

12 years agoNeed bwlimit.py from util-vserver-pl. Adding it at NodeManager to keep track of
Xavi Leon [Fri, 2 Dec 2011 16:47:52 +0000 (11:47 -0500)]
Need bwlimit.py from util-vserver-pl. Adding it at NodeManager to keep track of
the changes.

12 years agoRefactor of sliver_lxc and sliver_libvirt.
Xavi Leon [Mon, 28 Nov 2011 21:52:59 +0000 (16:52 -0500)]
Refactor of sliver_lxc and sliver_libvirt.

12 years agoRefactor of code to allow several virt techs. Minor bugs. Closes #8.
Xavi Leon [Thu, 10 Nov 2011 21:29:05 +0000 (16:29 -0500)]
Refactor of code to allow several virt techs. Minor bugs. Closes #8.

12 years agoCustom shell to allow a user to connect to its sliver using the slice_name.
Xavi Leon [Thu, 10 Nov 2011 17:08:31 +0000 (12:08 -0500)]
Custom shell to allow a user to connect to its sliver using the slice_name.

12 years agoMerge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel
Xavi Leon [Thu, 10 Nov 2011 15:42:10 +0000 (10:42 -0500)]
Merge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel

Conflicts:
sliver_libvirt.py

12 years agoFix hostname.
Marco Yuen [Thu, 10 Nov 2011 15:32:02 +0000 (10:32 -0500)]
Fix hostname.

12 years agoNeeded to define a password for the slice user (e.g. *) to allow ssh access. If not...
Xavi Leon [Thu, 10 Nov 2011 15:23:59 +0000 (10:23 -0500)]
Needed to define a password for the slice user (e.g. *) to allow ssh access. If not, sshd does not grant access to this user even with PK auth. Also, removed home user dir when destroying guest.

12 years agofix bug in name lookup of memory reservation
smbaker [Thu, 10 Nov 2011 02:12:03 +0000 (18:12 -0800)]
fix bug in name lookup of memory reservation

12 years agoMerge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel
Marco Yuen [Wed, 9 Nov 2011 21:11:05 +0000 (16:11 -0500)]
Merge branch 'lxc_devel' of github.com:planetlab/NodeManager into lxc_devel

12 years agoMinor code clean out.
Marco Yuen [Wed, 9 Nov 2011 21:10:44 +0000 (16:10 -0500)]
Minor code clean out.

12 years agoAdded config_template.xml to track future changes...
Xavi Leon [Wed, 9 Nov 2011 17:37:19 +0000 (12:37 -0500)]
Added config_template.xml to track future changes...

12 years agoCopy the rootfs from a reference image.
Xavi Leon [Wed, 9 Nov 2011 16:33:42 +0000 (11:33 -0500)]
Copy the rootfs from a reference image.
Ensure that the fs is removed once the sliver is removed.
The reference image along with the template config file has been moved to /vservers/.lvref
The reference image is named after myplc tags in the following way to allow other images configured from plc:
pldistro = lxc
fcdistro = squeeze
arch = x86_64
Closes #3

12 years agoStop and destroy working correctly. Unix accounts created on configure method.
Xavi Leon [Wed, 9 Nov 2011 15:21:09 +0000 (10:21 -0500)]
Stop and destroy working correctly. Unix accounts created on configure method.
Closes #1

12 years agomemory scheduling, and cpu scheduling preference for siblings
smbaker [Wed, 9 Nov 2011 07:16:46 +0000 (23:16 -0800)]
memory scheduling, and cpu scheduling preference for siblings

12 years agoSome code refactor
Xavi Leon [Tue, 8 Nov 2011 19:41:54 +0000 (14:41 -0500)]
Some code refactor

12 years agoAdded registration for Sliver_LV account type
Xavi Leon [Mon, 7 Nov 2011 23:00:04 +0000 (18:00 -0500)]
Added registration for Sliver_LV account type

12 years agoNew file sliver_libvirt. Basic code to create, start and check if it's running. Destr...
Xavi Leon [Mon, 7 Nov 2011 22:52:26 +0000 (17:52 -0500)]
New file sliver_libvirt. Basic code to create, start and check if it's running. Destroy and stop never called. New sliver tag, type = sliver.LIBVIRT

12 years agoFixed directory strings
xavileon [Mon, 24 Oct 2011 20:37:37 +0000 (16:37 -0400)]
Fixed directory strings

12 years agolxc skeleton. create, is_runnng works. Need clean up.
xavileon [Mon, 24 Oct 2011 20:13:19 +0000 (16:13 -0400)]
lxc skeleton. create, is_runnng works. Need clean up.

12 years agoBare minimum to get NodeManager not throw exceptions
xavileon [Fri, 21 Oct 2011 22:18:38 +0000 (18:18 -0400)]
Bare minimum to get NodeManager not throw exceptions

12 years agoParameter 'rec' missing in __init__ method
xavileon [Fri, 21 Oct 2011 21:41:28 +0000 (17:41 -0400)]
Parameter 'rec' missing in __init__ method

12 years agocouple of imports missing...
xavileon [Fri, 21 Oct 2011 19:23:28 +0000 (15:23 -0400)]
couple of imports missing...

12 years agoFirst upload of LXC code
xavileon [Fri, 21 Oct 2011 18:57:41 +0000 (14:57 -0400)]
First upload of LXC code

12 years agoFirst commit of LXC code
xavileon [Fri, 21 Oct 2011 18:54:33 +0000 (14:54 -0400)]
First commit of LXC code

12 years agoSetting tag nodemanager-2.0-33 nodemanager-2.0-1 nodemanager-2.0-33 nodemanager-2.1-0
Thierry Parmentelat [Thu, 7 Jul 2011 09:22:04 +0000 (11:22 +0200)]
Setting tag nodemanager-2.0-33
tweaked log policy for the core scheduler
curlwrapper has an optional verbose mode

12 years agodo not log messages about slices that receive default coresched reservations
smbaker [Fri, 1 Jul 2011 23:52:32 +0000 (16:52 -0700)]
do not log messages about slices that receive default coresched reservations

12 years agocurlwrapper has a verbose mode that can be turned on manually
Thierry Parmentelat [Wed, 29 Jun 2011 13:46:26 +0000 (15:46 +0200)]
curlwrapper has a verbose mode that can be turned on manually

12 years agosvn keywords and cosmetic
Thierry Parmentelat [Tue, 28 Jun 2011 20:15:18 +0000 (22:15 +0200)]
svn keywords and cosmetic

12 years agoSetting tag nodemanager-2.0-32 nodemanager-2.0-32
Baris Metin [Mon, 6 Jun 2011 18:48:29 +0000 (14:48 -0400)]
Setting tag nodemanager-2.0-32
fixes for hmac and omf_control tags
optional besteffort flag to core scheduler
logrotate entry for /var/log/nodemanager.daemon
a template for bash initscripts

12 years agofix passing optional -i to vuseradd
Thierry Parmentelat [Mon, 23 May 2011 13:50:00 +0000 (15:50 +0200)]
fix passing optional -i to vuseradd

12 years agoAdd isolated_loopback slice tag support.
Stephen Soltesz [Thu, 12 May 2011 21:46:01 +0000 (17:46 -0400)]
Add isolated_loopback slice tag support.

12 years agoapparently this is just a bug. we can set both hmac and omf_control tags
Baris Metin [Mon, 9 May 2011 21:50:09 +0000 (17:50 -0400)]
apparently this is just a bug. we can set both hmac and omf_control tags

12 years agocan not set sliver tags for system slices
Baris Metin [Mon, 9 May 2011 21:45:09 +0000 (17:45 -0400)]
can not set sliver tags for system slices

13 years agoMerge commit 'origin/master'
root [Tue, 5 Apr 2011 23:52:33 +0000 (01:52 +0200)]
Merge commit 'origin/master'

13 years agoadd optional besteffort flag to core scheduler
smbaker [Tue, 5 Apr 2011 23:50:10 +0000 (16:50 -0700)]
add optional besteffort flag to core scheduler

13 years agoMerge commit 'origin/master'
root [Fri, 1 Apr 2011 20:58:20 +0000 (22:58 +0200)]
Merge commit 'origin/master'

13 years agoAdd a logrotate entry for /var/log/nodemanager.daemon, which can get
Stephen Soltesz [Fri, 1 Apr 2011 20:54:55 +0000 (16:54 -0400)]
Add a logrotate entry for /var/log/nodemanager.daemon, which can get
out-of-hand on some nodes filling up the root partition.

13 years agoa yum_install function
Thierry Parmentelat [Wed, 23 Mar 2011 14:19:28 +0000 (15:19 +0100)]
a yum_install function

13 years agomoved where it belongs
Thierry Parmentelat [Wed, 23 Mar 2011 08:29:46 +0000 (09:29 +0100)]
moved where it belongs

13 years agoMerge branch 'master' of ssh://git.onelab.eu/git/nodemanager
Thierry Parmentelat [Wed, 23 Mar 2011 08:21:40 +0000 (09:21 +0100)]
Merge branch 'master' of ssh://git.onelab.eu/git/nodemanager

13 years agoa template for bash initscripts
Thierry Parmentelat [Wed, 23 Mar 2011 08:21:32 +0000 (09:21 +0100)]
a template for bash initscripts

13 years agoSetting tag nodemanager-2.0-31 nodemanager-2.0-31
Thierry Parmentelat [Tue, 22 Mar 2011 12:27:40 +0000 (13:27 +0100)]
Setting tag nodemanager-2.0-31
rename initscript_body into initscript_code
fix generic vinit for broken bash syntax &>>

13 years agoMerge branch 'master' of ssh://git.onelab.eu/git/nodemanager
Thierry Parmentelat [Mon, 21 Mar 2011 22:07:14 +0000 (23:07 +0100)]
Merge branch 'master' of ssh://git.onelab.eu/git/nodemanager

13 years agofix syntax error
S.Çağlar Onur [Mon, 21 Mar 2011 22:01:22 +0000 (18:01 -0400)]
fix syntax error

13 years agorename initscript_body into initscript_code
Thierry Parmentelat [Mon, 21 Mar 2011 21:53:15 +0000 (22:53 +0100)]
rename initscript_body into initscript_code

13 years agofix for fedora 8 that has broken bash &>>
Thierry Parmentelat [Mon, 21 Mar 2011 14:56:28 +0000 (15:56 +0100)]
fix for fedora 8 that has broken bash &>>

13 years agoSetting tag nodemanager-2.0-30 nodemanager-2.0-30
Thierry Parmentelat [Sun, 20 Mar 2011 23:51:28 +0000 (00:51 +0100)]
Setting tag nodemanager-2.0-30
new initscript_body slice tag, with stop and restart
generic vinit script live updated
new coresched module
protect against non-existing vsys scripts
use Config. instead of globals

13 years agoGenerate an error, not exception when an unknown tag is used
Sapan Bhatia [Fri, 18 Mar 2011 19:21:21 +0000 (15:21 -0400)]
Generate an error, not exception when an unknown tag is used

13 years agoexpect slice initscript to implement stop and restart
Thierry Parmentelat [Fri, 18 Mar 2011 09:21:34 +0000 (10:21 +0100)]
expect slice initscript to implement stop and restart
generic initscript to call slice initscript with stop/restart
rerun now invokes generic script
update generic initscript into slices at each cycle too

13 years agorestart nm upon make sync
Thierry Parmentelat [Fri, 18 Mar 2011 09:19:27 +0000 (10:19 +0100)]
restart nm upon make sync

13 years agoif 'initscript_body' is defined on a slice, its contents is used (as the text)
Thierry Parmentelat [Wed, 16 Mar 2011 16:53:00 +0000 (17:53 +0100)]
if 'initscript_body' is defined on a slice, its contents is used (as the text)
in this case 'initscript' is not considered at all

13 years agorerun initscript with 'restart' argument if the initscript is changed after the slive...
smbaker [Sun, 13 Mar 2011 03:46:14 +0000 (19:46 -0800)]
rerun initscript with 'restart' argument if the initscript is changed after the sliver has been created

13 years agosupport for scheduling cores to slices
smbaker [Wed, 9 Mar 2011 00:27:42 +0000 (16:27 -0800)]
support for scheduling cores to slices

13 years agoPick up changes in plc_config
Andy Bavier [Mon, 28 Feb 2011 22:26:28 +0000 (17:26 -0500)]
Pick up changes in plc_config

PL-23
Get bwmon to pick up changes in /etc/planetlab/plc_config without restarting NodeManager.

13 years agoSetting tag nodemanager-2.0-29 nodemanager-2.0-29
Thierry Parmentelat [Sun, 20 Feb 2011 10:45:21 +0000 (11:45 +0100)]
Setting tag nodemanager-2.0-29
more robust reservation plugin

13 years agoMerge branch 'master' of ssh://git.onelab.eu/git/nodemanager
Thierry Parmentelat [Sun, 20 Feb 2011 10:43:41 +0000 (11:43 +0100)]
Merge branch 'master' of ssh://git.onelab.eu/git/nodemanager

13 years agomore robust reservation module
Thierry Parmentelat [Fri, 18 Feb 2011 14:44:29 +0000 (15:44 +0100)]
more robust reservation module

13 years agotweak warning message
Thierry Parmentelat [Fri, 18 Feb 2011 12:45:36 +0000 (13:45 +0100)]
tweak warning message

13 years agoSetting tag nodemanager-2.0-28 nodemanager-2.0-28
Thierry Parmentelat [Thu, 17 Feb 2011 21:01:21 +0000 (22:01 +0100)]
Setting tag nodemanager-2.0-28
bind-mount slice's .ssh into sliver for omf-friendly slices - no need to use dotsshmount (vsys) anymore
reservation plugin more robust

13 years agoexpose .ssh in homedir only for omf-friendly slices
Thierry Parmentelat [Thu, 17 Feb 2011 15:15:38 +0000 (16:15 +0100)]
expose .ssh in homedir only for omf-friendly slices

13 years agosvn kwds
Thierry Parmentelat [Thu, 17 Feb 2011 15:14:44 +0000 (16:14 +0100)]
svn kwds

13 years agofirst working version of .ssh getting exposed to slices
Thierry Parmentelat [Thu, 17 Feb 2011 14:34:34 +0000 (15:34 +0100)]
first working version of .ssh getting exposed to slices
done for all slices at this point, next step will handle omf-friendly
slices only

13 years agoreview reservation module
Thierry Parmentelat [Wed, 16 Feb 2011 20:02:21 +0000 (21:02 +0100)]
review reservation module

13 years agoMerge branch 'master' of ssh://git.onelab.eu/git/nodemanager
Thierry Parmentelat [Wed, 16 Feb 2011 19:58:22 +0000 (20:58 +0100)]
Merge branch 'master' of ssh://git.onelab.eu/git/nodemanager

13 years agobind mount sliver's .ssh dir into the slice
Thierry Parmentelat [Wed, 16 Feb 2011 19:58:12 +0000 (20:58 +0100)]
bind mount sliver's .ssh dir into the slice

13 years agosvn-keywords
Thierry Parmentelat [Wed, 16 Feb 2011 17:36:09 +0000 (18:36 +0100)]
svn-keywords

13 years agoimport sfa.util.config.Config as SSfaConfig to avoid interference with nodemanagers...
Tony Mack [Tue, 8 Feb 2011 22:07:19 +0000 (17:07 -0500)]
import sfa.util.config.Config as SSfaConfig to avoid interference with nodemanagers config class