Latest version

[alkalo...@gmail.com]

Hello

I have updated to the latest stable version, but when running I am getting


Exception occured in grid-control [1864]

PluginError: Error while creating instance: 'grid_control.workflow.Workflow'
  PluginError: Error while creating instance: 'grid_control_cms.cmssw_advanced.CMSSW_Advanced'
    PluginError: Error while creating instance: 'grid_control_cms.provider_dbsv3.DBS3Provider'
      ConfigError: Unable to parse plugin: [cmssw_advanced] nickname source = nickProducer.signalNicks
        PluginError: Unable to load 'nickProducer.signalNicks' of type 'grid_control.datasets.dproc_base:DataProcessor'
        searched plugin names:
                nickProducer.signalNicks

          ImportError: cannot import name DatasetError

I am still using the nickProducer.py from an older version, so can you point me where I can find the latest one ? Also, I have issues running under CMSSW_8_0_12 ie with the old version I was getting


GCError: Error while creating instance of type CMSSW_Advanced (grid_control_cms.cmssw_advanced.CMSSW_Advanced)
HTTPError:


Kind regards

Alexis

[Fred Stober]

Hi,

The location of the Nickname base class changed in between - there is an easy way to make it "future proof" by getting the base class via the plugin framework (as it is also done in the current nickname producer example in  docs/examples/Example05_dataset.py):

from hpfwk import Plugin

class MyNickNameProducer(Plugin.getClass('NickNameProducer')):

  def getName(self, oldnick, dataset, block):

    ...

I'm only a bit confused about the error message - "cannot import name DatasetError" can you attach the debug.log from your gc directory?

The HTTPError from the old version is probably some problem with retrieving the dataset information - the new version will give much more details about what's going wrong with it.

 * Did you create a voms proxy before you started gc? Both DBS3 and DAS require having a voms proxy nowadays.

 * Are you sure there are no typos in the dataset string?

Cheers,

Fred

[alkalo...@gmail.com]

Hi Fred

I reverted back to my old version (469:1395), and with a fresh proxy certificate, I still get this

URLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:591)


it is true that I had to renew my certificate (ie the usercert/userkey) as they expired couple of weeks ago, but the same certificate works ok mapped in mozilla so to work with DAS.

Thanks again

[alkalo...@gmail.com]

Hi Fred

I reverted back to my old version (469:1395), and with a fresh proxy certificate, I still get this

URLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:591)


it is true that I had to renew my certificate (ie the usercert/userkey) as they expired couple of weeks ago, but the same certificate works ok mapped in mozilla so to work with DAS.

Thanks again

[Fred Stober]

Hi,

Python version >2.7.9 enabled some more thorough ca verification, and the cmsweb certificate needs some help to pass this new check. You can either try an older python version or try again to use the latest stable gc release. If you still have issues with this version, please attach the debug.log file.

Cheers, Fred

[alkalo...@gmail.com]

So, I am indeed trying with python2.7 (ie older that the one integrated in 8.0.12) and here is my debug.log (please notice that I reverted back to my old grid-tools version which used to work just fine...)

http://desy.de/~alkaloge/debug.log

thanks in advance

[Fred Stober]

Hi,

from the debug log I can see that you get HTTP error 403 - forbidden. I think it is likely that you are just failing the server certificate verification. With CMSSW 8.0.12 you get Python 2.7.11, which does have the more stringent certificate check.

I can only see 3 ways out of this:

 * call explicitely python2.6 go.py ...

 * try to patch the webservice.py to include the CA workaround

 * use grid-control r1864 - if you have trouble using this version, I would be *very* interested in the debug.log. The only thing that should change is where the NickNameProducer is located. You can also do: 

try:

from hpfwk import Plugin

NickNameProducer = Plugin.getClass('NickNameProducer')

except:

   from grid_control.datasets import NickNameProducer

so the file works with old, current and future gc versions.

Cheers,

Fred

[alkalo...@gmail.com]

hi

So, here is the debug with 1864

http://desy.de/~alkaloge/debug.log

trying to implement the changes for the NickProducer I get this

Exception occured in grid-control [1864]

PluginError: Error while creating instance: 'grid_control.workflow.Workflow'
  PluginError: Error while creating instance: 'grid_control_cms.cmssw_advanced.CMSSW_Advanced'
    PluginError: Error while creating instance: 'grid_control_cms.provider_dbsv3.DBS3Provider'
      ConfigError: Unable to parse plugin: [cmssw_advanced] nickname source = nickProducer.signalNicks
        PluginError: Unable to load 'nickProducer.signalNicks' of type 'grid_control.datasets.dproc_base:DataProcessor'
    searched plugin names:
        nickProducer.signalNicks

          SyntaxError: invalid syntax (nickProducer.py, line 7)
                       ('invalid syntax', ('/nfs/dust/cms/user/alkaloge/TauAnalysis/new/new/CMSSW_8_0_12/src/DesyTauAnalyses/NTupleMaker/test/nickProducer.py', 7, 6, 'except:\n'))


I am also putting my nickProducer here in case you can edit it to something that can work


http://desy.de/~alkaloge/nickProducer.py

Cheers

Alex

[Fred Stober]

Hi,

since the dust space isn't  working atm, I've looked at the source code here:

https://github.com/DesyTau/DesyTauAnalyses/blob/master/DesyTauAnalyses/NTupleMaker/test/nickProducer.py

forked it and made a pull request with the fix.

At least I now understand your DatasetError import problem from above :) - it also moved places but since you don't need it you can simply remove it.

I'm not sure how you got the syntax error (something might've happened during copy&paste...)

Cheers,

Fred

[alkalo...@gmail.com]

Hi Fred

So, trying with your nickproducer I still get this

Exception occured in grid-control [1864]

PluginError: Error while creating instance: 'grid_control.workflow.

Workflow'
  PluginError: Error while creating instance: 'grid_control_cms.cmssw_advanced.CMSSW_Advanced'

    DatasetError: Unable to retrieve dataset '/SingleMuon/Run2016B-PromptReco-v2/MINIAOD'
      RestError: Request result: <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en">
 <head>
 <title>CMSWEB Error: Authorisation required</title>
 <meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
 <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon" />
 <link rel="stylesheet" type="text/css" media="screen" href="/css/cmsweb.css" />
</head>
<body>
 <div id="main">
  <div id="top">
   <div class="boxTitle"><img src="/img/title.gif" alt="CMSWEB (title)" /></div>
  </div>
  <div id="middle">
   <div class="boxLinkContainer">
    <h2>Authorisation required</h2>
    <p>The site you requested is protected and requires you to authenticate</p><p><a href='/auth/trouble'>Diagnose certificate problems</a></p>
   </div>
  </div>
  <div id="bottom">
   <div class="boxFooter">&nbsp;</div>
  </div>
 </div>
</body>
</html>

the debug is here

desy.de/~alkaloge/debug.log

Cheers