sfa.git
7 years agoSetting tag sfa-3.1-21 sfa-3.1-21
Thierry Parmentelat [Fri, 13 Jan 2017 17:12:24 +0000 (18:12 +0100)]
Setting tag sfa-3.1-21
sfax509 command can run openssl x509 on all the parts of a gid
bugfix in sfi when running the discover subcommand
PEP8'ed a substantial part of the code
additional debug in chain verification
sfi myslice more robust - ignores broken slices
new sfi introspect
for myslice: the trust/ package should be python3-ready
* provided that m2crypto is
* although the devel version of m2crypto wroks just fine for us
* even if it's incomplete for other aspects that we do not care about

7 years agono change - only notes on using the openssl command line for debugging
Thierry Parmentelat [Fri, 13 Jan 2017 12:34:23 +0000 (13:34 +0100)]
no change - only notes on using the openssl command line for debugging

7 years agocosmetic
Thierry Parmentelat [Fri, 13 Jan 2017 12:21:52 +0000 (13:21 +0100)]
cosmetic

7 years agofix broken file after pep8
Thierry Parmentelat [Fri, 13 Jan 2017 12:21:41 +0000 (13:21 +0100)]
fix broken file after pep8

7 years agoMerge branch 'geni-v3' into pep8
Thierry Parmentelat [Fri, 13 Jan 2017 12:14:17 +0000 (13:14 +0100)]
Merge branch 'geni-v3' into pep8

* geni-v3:
  more, and more legible, debug messages in the cert verification area
  sfax509 will run openssl x509 on all parts of a gid
  ignore html and pdf files when doing stuff like make tags
  bugfix in sfi when running the discover subcommand

# Conflicts:
# sfa/trust/certificate.py
# sfa/trust/gid.py

7 years agomore, and more legible, debug messages in the cert verification area
Thierry Parmentelat [Fri, 13 Jan 2017 12:10:15 +0000 (13:10 +0100)]
more, and more legible, debug messages in the cert verification area

7 years agosfax509 will run openssl x509 on all parts of a gid
Thierry Parmentelat [Fri, 13 Jan 2017 11:47:48 +0000 (12:47 +0100)]
sfax509 will run openssl x509 on all parts of a gid

7 years agoignore html and pdf files when doing stuff like make tags
Thierry Parmentelat [Fri, 13 Jan 2017 11:10:38 +0000 (12:10 +0100)]
ignore html and pdf files when doing stuff like make tags

7 years agobugfix in sfi when running the discover subcommand
Thierry Parmentelat [Fri, 13 Jan 2017 11:09:17 +0000 (12:09 +0100)]
bugfix in sfi when running the discover subcommand

7 years agoautopep8
Thierry Parmentelat [Wed, 11 Jan 2017 13:30:28 +0000 (14:30 +0100)]
autopep8

7 years agoa possible rewrite for a change suggested by Loic
Thierry Parmentelat [Fri, 6 Jan 2017 14:30:45 +0000 (15:30 +0100)]
a possible rewrite for a change suggested by Loic
not tested at all

7 years agovery few minor pep8 tweaks
Thierry Parmentelat [Fri, 6 Jan 2017 14:30:21 +0000 (15:30 +0100)]
very few minor pep8 tweaks

7 years agoError in Credential logger GID pretty_cert
Loic Baron [Thu, 5 Jan 2017 07:21:18 +0000 (08:21 +0100)]
Error in Credential logger GID pretty_cert

7 years agoapply Loic's changes only in python3 for extra safety
Thierry Parmentelat [Fri, 20 May 2016 08:19:10 +0000 (10:19 +0200)]
apply Loic's changes only in python3 for extra safety

7 years agoPython3 compatibility for Credential & Certificate in save_to_string & save_to_file...
Loic Baron [Thu, 19 May 2016 09:17:47 +0000 (11:17 +0200)]
Python3 compatibility for Credential & Certificate in save_to_string & save_to_file (bytes to string)

8 years agomake references to the OpenSSL and M2Crypto more explicit
Thierry Parmentelat [Mon, 4 Apr 2016 20:51:21 +0000 (22:51 +0200)]
make references to the OpenSSL and M2Crypto more explicit
also m2crypto is imported on the fly so one could at least load the module

8 years agoprettified certificate, credential and speaksfor_util
Thierry Parmentelat [Fri, 1 Apr 2016 10:56:21 +0000 (12:56 +0200)]
prettified certificate, credential and speaksfor_util

prettified speaks_for

8 years agoopen cache files in binary mode for pickle
Thierry Parmentelat [Fri, 1 Apr 2016 10:08:05 +0000 (12:08 +0200)]
open cache files in binary mode for pickle

8 years agoRSpecVersion.todict() needs to turn values() into a list()
Thierry Parmentelat [Fri, 1 Apr 2016 09:49:43 +0000 (11:49 +0200)]
RSpecVersion.todict() needs to turn values() into a list()

8 years agobasestring -> StringType
Thierry Parmentelat [Fri, 1 Apr 2016 09:24:25 +0000 (11:24 +0200)]
basestring -> StringType

8 years ago2to3 -f has_key
Thierry Parmentelat [Fri, 1 Apr 2016 09:41:55 +0000 (11:41 +0200)]
2to3 -f has_key

8 years agoopen() instead of file()
Thierry Parmentelat [Fri, 1 Apr 2016 09:22:25 +0000 (11:22 +0200)]
open() instead of file()

8 years agohttplib has gone too
Thierry Parmentelat [Fri, 1 Apr 2016 08:30:16 +0000 (10:30 +0200)]
httplib has gone too

8 years agosome occurrences of items() that need being converted into list()
Thierry Parmentelat [Fri, 1 Apr 2016 08:31:13 +0000 (10:31 +0200)]
some occurrences of items() that need being converted into list()

8 years agocosmetic + one tab required spaces instead
Thierry Parmentelat [Fri, 1 Apr 2016 09:24:12 +0000 (11:24 +0200)]
cosmetic + one tab required spaces instead

8 years agopurely cosmetic pass on sfaclientlib
Thierry Parmentelat [Fri, 1 Apr 2016 08:49:59 +0000 (10:49 +0200)]
purely cosmetic pass on sfaclientlib

8 years agoconvenience target to push on python3
Thierry Parmentelat [Fri, 1 Apr 2016 08:30:42 +0000 (10:30 +0200)]
convenience target to push on python3

8 years agooffically terminate eucalyptus & xmlbuilder
Thierry Parmentelat [Fri, 1 Apr 2016 09:51:29 +0000 (11:51 +0200)]
offically terminate eucalyptus & xmlbuilder

8 years agodeeper pass on xmlrpclib vs xmlrpc.client as well as configparser
Thierry Parmentelat [Thu, 31 Mar 2016 17:31:37 +0000 (19:31 +0200)]
deeper pass on xmlrpclib vs xmlrpc.client as well as configparser

8 years agoStringIO
Thierry Parmentelat [Thu, 31 Mar 2016 09:12:50 +0000 (11:12 +0200)]
StringIO

8 years agoremove useless imports
Thierry Parmentelat [Thu, 31 Mar 2016 09:08:33 +0000 (11:08 +0200)]
remove useless imports

8 years agodo not depend on types.StringTypes anymore
Thierry Parmentelat [Thu, 31 Mar 2016 08:00:40 +0000 (10:00 +0200)]
do not depend on types.StringTypes anymore

8 years agocosmetic
Thierry Parmentelat [Thu, 31 Mar 2016 08:12:48 +0000 (10:12 +0200)]
cosmetic

8 years ago2to3 -f except
Thierry Parmentelat [Thu, 31 Mar 2016 07:51:27 +0000 (09:51 +0200)]
2to3 -f except

8 years agoxmlrpclib.Fault for py3
Thierry Parmentelat [Thu, 31 Mar 2016 07:49:49 +0000 (09:49 +0200)]
xmlrpclib.Fault for py3

8 years agoa lingering raise
Thierry Parmentelat [Thu, 31 Mar 2016 07:27:01 +0000 (09:27 +0200)]
a lingering raise

8 years ago2to3 -f raise
Thierry Parmentelat [Thu, 31 Mar 2016 06:57:04 +0000 (08:57 +0200)]
2to3 -f raise

8 years ago2to3 -f print
Thierry Parmentelat [Thu, 31 Mar 2016 06:55:05 +0000 (08:55 +0200)]
2to3 -f print
from __future__ import print_function

8 years agodos2unix'ed
Thierry Parmentelat [Thu, 31 Mar 2016 06:41:55 +0000 (08:41 +0200)]
dos2unix'ed

8 years agoApplied patch from GENI by Aaron Helsinger
Thierry Parmentelat [Wed, 24 Feb 2016 09:41:54 +0000 (10:41 +0100)]
Applied patch from GENI by Aaron Helsinger
https://github.com/GENI-NSF/geni-tools/pull/894/files

8 years agosfi.py closer to PEP-8
Thierry Parmentelat [Fri, 5 Feb 2016 16:32:33 +0000 (17:32 +0100)]
sfi.py closer to PEP-8

8 years agosfi myslice more robust - won't fail when one slice is problematic
Thierry Parmentelat [Fri, 5 Feb 2016 16:27:02 +0000 (17:27 +0100)]
sfi myslice more robust - won't fail when one slice is problematic

8 years agobugfix - issue seen on PLE with slice onelab.upmc.fit_demo.wireless_fit
Thierry Parmentelat [Tue, 12 Jan 2016 09:13:04 +0000 (10:13 +0100)]
bugfix - issue seen on PLE with slice onelab.upmc.fit_demo.wireless_fit
there was a remaining underscore in the login_base produced by
hash_loginbase

8 years agosfi introspect
Thierry Parmentelat [Fri, 8 Jan 2016 12:06:17 +0000 (13:06 +0100)]
sfi introspect

8 years agobuild geni_rspec_version in a consistent way
Thierry Parmentelat [Thu, 7 Jan 2016 09:09:34 +0000 (10:09 +0100)]
build geni_rspec_version in a consistent way

8 years agoreview all commands for arg count check
Thierry Parmentelat [Thu, 7 Jan 2016 09:09:06 +0000 (10:09 +0100)]
review all commands for arg count check

8 years agorename get_m2_pkey into get_m2_pubkey in unit test as well
Thierry Parmentelat [Mon, 4 Jan 2016 10:16:17 +0000 (11:16 +0100)]
rename get_m2_pkey into get_m2_pubkey in unit test as well

8 years agoMerge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3
fsaintma [Fri, 18 Dec 2015 12:41:16 +0000 (13:41 +0100)]
Merge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3

8 years agoadd Dead state for unvailable nodes
fsaintma [Fri, 18 Dec 2015 12:40:54 +0000 (13:40 +0100)]
add Dead state for unvailable nodes

8 years agoimprove get_reserve_nodes
fsaintma [Fri, 18 Dec 2015 12:38:25 +0000 (13:38 +0100)]
improve get_reserve_nodes

8 years agoSetting tag sfa-3.1-20 sfa-3.1-20
Thierry Parmentelat [Thu, 17 Dec 2015 13:10:44 +0000 (14:10 +0100)]
Setting tag sfa-3.1-20
minor fixes for migrating on fedora23

8 years agobugfix - m2crypto verification function returns
Thierry Parmentelat [Thu, 17 Dec 2015 10:44:02 +0000 (11:44 +0100)]
bugfix - m2crypto verification function returns
. 1 in case of success
. but otherwise it may be 0 or -1

8 years agorename ambiguous pkey into pubkey
Thierry Parmentelat [Thu, 17 Dec 2015 10:38:05 +0000 (11:38 +0100)]
rename ambiguous pkey into pubkey

8 years agocosmetic changes only
Thierry Parmentelat [Thu, 17 Dec 2015 10:31:23 +0000 (11:31 +0100)]
cosmetic changes only

8 years agobetter patch for unverified_context
Thierry Parmentelat [Wed, 16 Dec 2015 08:22:06 +0000 (09:22 +0100)]
better patch for unverified_context

8 years agoprettified speaksfor a little
Thierry Parmentelat [Thu, 10 Dec 2015 10:56:18 +0000 (11:56 +0100)]
prettified speaksfor a little

8 years agobugfix, correct previous change on locating xmlsec1
Thierry Parmentelat [Thu, 10 Dec 2015 10:47:53 +0000 (11:47 +0100)]
bugfix, correct previous change on locating xmlsec1

8 years agono change, just sfi.py prettyfied wrt spaces and assignments
Thierry Parmentelat [Thu, 10 Dec 2015 09:17:37 +0000 (10:17 +0100)]
no change, just sfi.py prettyfied wrt spaces and assignments

8 years agomore aggressively check for xmlsec1 being installed,
Thierry Parmentelat [Thu, 10 Dec 2015 08:57:35 +0000 (09:57 +0100)]
more aggressively check for xmlsec1 being installed,
raise an exception otherwise

8 years agoSetting tag sfa-3.1-19 sfa-3.1-19
Thierry Parmentelat [Tue, 8 Dec 2015 10:29:29 +0000 (11:29 +0100)]
Setting tag sfa-3.1-19
imported changes from GENI as reported - Aaron Helsinger
minimal changes so that parts can be imported from nepi/py3
iotlab driver : fix ASAP jobs with state != Waiting, Running - Frederic
sfi client more accurately advertises rspec version - Loic
+ bugfix in initscript

8 years agoblind attempt to undo renaming of
Thierry Parmentelat [Fri, 4 Dec 2015 11:03:56 +0000 (12:03 +0100)]
blind attempt to undo renaming of
credential.type into credential.cred_type

8 years agochanges proposed by Aaron Helsinger and GENI
Thierry Parmentelat [Thu, 26 Nov 2015 08:43:23 +0000 (09:43 +0100)]
changes proposed by Aaron Helsinger and GENI

8 years agominimal changes to have this imported by nepi in py3
Thierry Parmentelat [Thu, 8 Oct 2015 15:32:43 +0000 (17:32 +0200)]
minimal changes to have this imported by nepi in py3

8 years agoMerge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3
Loic Baron [Mon, 28 Sep 2015 14:01:27 +0000 (16:01 +0200)]
Merge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3

8 years agoSFI client passing -r parameter even if the rspec_type is not known by sfi.py client
Loic Baron [Mon, 28 Sep 2015 14:00:20 +0000 (16:00 +0200)]
SFI client passing -r parameter even if the rspec_type is not known by sfi.py client

8 years agouse print_function in sfi.py
Thierry Parmentelat [Wed, 22 Jul 2015 09:57:23 +0000 (11:57 +0200)]
use print_function in sfi.py

8 years agofix broken sfi config
Thierry Parmentelat [Wed, 22 Jul 2015 09:53:11 +0000 (11:53 +0200)]
fix broken sfi config

8 years agoslight change in the initscript
Thierry Parmentelat [Tue, 21 Jul 2015 12:27:25 +0000 (14:27 +0200)]
slight change in the initscript
this is all very odd;
out of the blue the SFA service within its f20 VM (inside bigjohn that is a f21 LXC host) was not starting properly any longer..
the test to decide whether to start postgresql had to be rewritten, reading now
check || { start-db ; ... }
rather than
if [ ! check ] ; then start-db ... ; fi

8 years agofix ASAP jobs with state != Waiting,Running
fsaintma [Thu, 11 Jun 2015 07:24:10 +0000 (09:24 +0200)]
fix ASAP jobs with state != Waiting,Running

8 years agoMerge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3
fsaintma [Wed, 10 Jun 2015 07:23:47 +0000 (09:23 +0200)]
Merge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3

8 years agofix ASAP duration
fsaintma [Wed, 10 Jun 2015 07:23:32 +0000 (09:23 +0200)]
fix ASAP duration

8 years agoSetting tag sfa-3.1-18 sfa-3.1-18
Thierry Parmentelat [Mon, 8 Jun 2015 10:24:45 +0000 (12:24 +0200)]
Setting tag sfa-3.1-18
incorporated Frederic Saint Marcel's addition of ASAP management tag

8 years agoMerge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3
fsaintma [Mon, 8 Jun 2015 08:41:14 +0000 (10:41 +0200)]
Merge branch 'geni-v3' of ssh://git.onelab.eu/git/sfa into geni-v3

8 years agoadd ASAP mgt and fix start_time with ASAP jobs
fsaintma [Mon, 8 Jun 2015 08:41:11 +0000 (10:41 +0200)]
add ASAP mgt and fix start_time with ASAP jobs

8 years agoSetting tag sfa-3.1-17 sfa-3.1-17
Thierry Parmentelat [Fri, 5 Jun 2015 12:00:01 +0000 (14:00 +0200)]
Setting tag sfa-3.1-17
workaround for 'name' not being exposed properly by List() on authority objects
fix a corner case in PL importer
trashed module registry_manager_openstack

8 years agoworkaround the mysterious issue with sqlalchemy that returns instances of RegAuthorit...
Thierry Parmentelat [Fri, 5 Jun 2015 11:57:41 +0000 (13:57 +0200)]
workaround the mysterious issue with sqlalchemy that returns instances of RegAuthority that do not
have their __dict__ in line with the object's contents (specifically missing 'name')
a possibly other instance of that same issue was worked around in Update() using an extra print statement,
which I prefer to leave as is for now as I cannot test that thoroughly, but a similar approach would probably
be a solution in this case as well

8 years agocosmetic
Thierry Parmentelat [Fri, 5 Jun 2015 11:17:08 +0000 (13:17 +0200)]
cosmetic

8 years agocosmetic
Thierry Parmentelat [Fri, 5 Jun 2015 10:43:22 +0000 (12:43 +0200)]
cosmetic

8 years agoprettyfied registry manager (+format)
Thierry Parmentelat [Fri, 5 Jun 2015 10:43:06 +0000 (12:43 +0200)]
prettyfied registry manager (+format)

8 years agowith instead of open/close
Thierry Parmentelat [Fri, 5 Jun 2015 10:40:15 +0000 (12:40 +0200)]
with instead of open/close

8 years agoRecord.todict behaves suspisciously
Thierry Parmentelat [Fri, 5 Jun 2015 10:06:23 +0000 (12:06 +0200)]
Record.todict behaves suspisciously
no change for now, but we disambiguate between XML.todict() and Record.todict()
so we can more easily spot which is which

8 years agocleaned up saving-to-file functions in sfi - now always displays a message when writi...
Thierry Parmentelat [Fri, 5 Jun 2015 10:03:23 +0000 (12:03 +0200)]
cleaned up saving-to-file functions in sfi - now always displays a message when writing a file

8 years agotrashed registry_manager_openstack
Thierry Parmentelat [Fri, 5 Jun 2015 10:02:03 +0000 (12:02 +0200)]
trashed registry_manager_openstack

8 years agoremove printing 'name' in low-level record utilities, as UTF-8 values can create...
Thierry Parmentelat [Fri, 5 Jun 2015 08:10:29 +0000 (10:10 +0200)]
remove printing 'name' in low-level record utilities, as UTF-8 values can create serious errors on the server side if ill-configured

8 years agofix corner case in PL importer
Thierry Parmentelat [Fri, 5 Jun 2015 08:09:31 +0000 (10:09 +0200)]
fix corner case in PL importer

8 years agoall sfi commands that support -t/--type now accept a 2-chars shorthand
Thierry Parmentelat [Fri, 5 Jun 2015 07:41:21 +0000 (09:41 +0200)]
all sfi commands that support -t/--type now accept a 2-chars shorthand

8 years agoadd a useless print statement to work around a weird issue we have with sqlalchemy...
Thierry Parmentelat [Fri, 5 Jun 2015 07:14:28 +0000 (09:14 +0200)]
add a useless print statement to work around a weird issue we have with sqlalchemy objects and their __dict__ value being wrong
this is the second occurrence of that issue and a better solution is clearly needed
in the mix, record.todict() now expects a tuple of types to exclude; this way we can use isinstance natively

8 years agorepr() of Reg objects shows email and name if present
Thierry Parmentelat [Fri, 5 Jun 2015 07:12:08 +0000 (09:12 +0200)]
repr() of Reg objects shows email and name if present

8 years agono change - spaces
Thierry Parmentelat [Fri, 5 Jun 2015 07:11:27 +0000 (09:11 +0200)]
no change - spaces

8 years agoSetting tag sfa-3.1-16 sfa-3.1-16
Thierry Parmentelat [Thu, 4 Jun 2015 12:18:29 +0000 (14:18 +0200)]
Setting tag sfa-3.1-16
added a new builtin column 'name' for authorities in the sfa registry
this is kept in sync with MyPLC's site names when relevant
sfa update -t authority thus now has a new -n/--name option
sfi register or update can specify record type on only 2 characters (au, us, no, or sl)
reviewed Describe and Allocate wrt slice tags for a PL AM:
Describe now exposes all slice tags with a 'scope' being 'sliver' or 'slice'
Allocate now by default ignores incoming slice tags
Allocate's options can mention 'pltags' among 'ignore', 'append', 'sync'
default being 'ignore'
in 'ignore' mode, slice tags are unchanged in the PL db
in 'append' mode, slice tags from the rspec are added to the db unless
they are already present
in 'sync' mode, the code attempts to leave the PL db in sync with the tags
provided in rspec; this can be dangerous and is thus no longer the default
behaviour

8 years agouser needs to specify 'pltags':'sync' in the options to Allocate to use standard...
Thierry Parmentelat [Thu, 4 Jun 2015 12:07:14 +0000 (14:07 +0200)]
user needs to specify 'pltags':'sync' in the options to Allocate to use standard behaviour, insted of more confusing 'match'

8 years agoremoved the 'append' option to Allocate in the PL driver;
Thierry Parmentelat [Wed, 3 Jun 2015 15:54:17 +0000 (17:54 +0200)]
removed the 'append' option to Allocate in the PL driver;
replaced with the 'pltags' option that can be either 'ignore' (default), 'append' (only add the provided tags if not yet present) or anything else (try to do the magic, which is known to be a little fragile)

8 years agoadd a docstring note about Allocate and the append option
Thierry Parmentelat [Wed, 3 Jun 2015 15:12:37 +0000 (17:12 +0200)]
add a docstring note about Allocate and the append option

8 years agomajor fix about slice tags
Thierry Parmentelat [Wed, 3 Jun 2015 14:17:43 +0000 (16:17 +0200)]
major fix about slice tags
no slice tags was exposed by sfi describe before this change
we now expose them properly with a 'scope' field that can be either 'slice' or 'sliver'
note that nodegroup-based tags are still silently ignored at this point
---
using allocate with the 'append' option is probably the best approach anyway, with an empty list of slice tags; this avoid resetting slice tags

8 years agoimproved sfi describe : show help is wrong number of args, use a context manager...
Thierry Parmentelat [Wed, 3 Jun 2015 14:15:18 +0000 (16:15 +0200)]
improved sfi describe : show help is wrong number of args, use a context manager for opening input file

8 years agono change - various tweaks here and there
Thierry Parmentelat [Wed, 3 Jun 2015 14:14:38 +0000 (16:14 +0200)]
no change - various tweaks here and there

8 years agoprettyfied - spaces
Thierry Parmentelat [Wed, 3 Jun 2015 10:20:32 +0000 (12:20 +0200)]
prettyfied  - spaces

8 years agoadded debug traces
Thierry Parmentelat [Wed, 3 Jun 2015 10:13:28 +0000 (12:13 +0200)]
added debug traces

8 years agono change - use format instead of % in plimporter pldriver plslices
Thierry Parmentelat [Wed, 3 Jun 2015 10:12:44 +0000 (12:12 +0200)]
no change - use format instead of % in plimporter pldriver plslices

8 years agobelongs with previous change
Thierry Parmentelat [Wed, 3 Jun 2015 09:54:53 +0000 (11:54 +0200)]
belongs with previous change