[Issues] Problems with Gastrometric
John P. McFarland
mcfarland at astro.rug.nl
Thu Sep 13 08:51:36 CEST 2007
Hi Philippe,
I assume you are getting these errors while running from Boon. I have
recently made a test installation of Astro-WISE in Leiden in preparation for
a full installation there, but I am currently having some issues with LDAC.
I tried this command of yours there and reproduce the problem exactly.
Because I cannot reproduce your problem in Groningen, I assume there may be
an issue similar to the one in Leiden in Bonn.
To test if this is the case, could you please run the unittests there and
return errors here? The process would be to run the dependency and
regression tests as a unit (this will take 10-20 minutes):
# dependency tests
env database_engine= awe ${AWEPIPE}/astro/test/dependency_test.py
# functional tests (individual tests in astro/test/functional)
env database_engine= awe ${AWEPIPE}/astro/test/regression_test.py -f
# processing tests (individual tests in astro/test/processing)
env database_engine= awe ${AWEPIPE}/astro/test/regression_test.py -p
When you have an error, for example:
AstrometricParameters_test... 1 ERRORS, 0 FAILURES, 2 Successes
run that test individually (please ignore any GalPhot and TinyTim errors,
and any version errors for SExtractor and SWarp):
env database_engine= awe ${AWEPIPE}/astro/test/processing/AstrometricParameters_test.py
and return the error output.
All this will hopefully allow us to pin down the causes of the errors and
resolve them quickly.
Cheers,
-=John
On Tue, 11 Sep 2007, Philippe Heraudeau wrote:
> Hi John,
>
> I was already using a fresh checkout of AWBASE.
> I did it again and the problem remains.
>
> Philippe
>
> John P. McFarland wrote:
>> Hi Philippe,
>>
>> I am unable to reproduce your problem (see extended output below). Try to
>> run from a fresh checkout of AWBASE:
>>
>> ...]$ cvs checkout -r AWBASE -d your_awbase_directory opipe
>> ...]$ setenv AWEPIPE=your_awbase_directory
>> ...]$ awe
>>
>> where your_awbase_directory is the full pathname of the fresh AWBASE
>> checkout. If this works fine, you have something wrong with the AWBASE
>> checkout you have been using. If not, please let me know.
>>
>> Cheers,
>>
>>
>> -=John
>>
>>
>>
>> Python 2.3.5 (#4, Aug 15 2005, 11:45:46)
>> [GCC 3.4.3 20050227 (Red Hat 3.4.3-22.1)] on linux2
>> Type "help", "copyright", "credits" or "license" for more information.
>>
>>
>> Welcome to the Astro-WISE Environment
>>
>> |07-SEP-07 All mx DateTimes have been changed to Python datetimes.
>> The is necessary for a transition to Python 2.5. When doing
>> queries using dates you will need to use a different
>> syntax.
>> See "More examples" in the query howto on our webpage
>> (AWE Information System -> Howtos & Manual -> AWE
>> Environment
>> -> Queries).
>> |28-AUG-07 The astro.main.Config and DiaConfig modules have been
>> completely rewritten to allow for greater uniformity and
>> versatility. See the News list item for more information.
>> |28-AUG-07 The astro.external.Sextractor, Swarp, LDAC, and Dia
>> interfaces
>> have been rewriten to take advantage the new Config
>> interface.
>> See the News list item for more information.
>>
>> | You are running the AWBASE version
>>
>> Importing Astro-WISE packages. Please wait...
>>
>> Initializing Distributed Processing Unit...
>>
>> Current profile:
>> - username : awjmcfarland
>> - database : db.astro.rug.astro-wise.org
>> - project : ALL
>>
>> awe> from astro.plot.AstrometryStatistics import AstrometryStatistics
>> awe> task = GAstromTask( instrument='WFI' , C=0,
>> raw_filenames=['WFI.2000-03-30T06:23:02.880_2.fits','WFI.2000-03-30T06:29:29.466_2.fits','WFI.2000-03-30T06:10:13.781_2.fits','WFI.2000-03-30T06:16:37.269_2.fits','WFI.2000-03-30T06:36:06.137_2.fits'],chip='ccd51',inspect=1)
>> awe> task.execute()
>> [harriot] 12:32:13 - Querying database for instances of class
>> ReducedScienceFrame...
>> [harriot] 12:32:17 - Using SourceList
>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5740235-773a53b1b092f19ca995a54bfda4e3f8f7a06e08.fits.slist,
>> SLID= 188921, number of sources = 315
>> [harriot] 12:32:17 - Using SourceList
>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5701493-864541ce1b63a1746ebe60f74004c423789992ff.fits.slist,
>> SLID= 188891, number of sources = 347
>> [harriot] 12:32:17 - Using SourceList
>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5727470-ad8f21d2abb23a04be01c0b2e8e4743e824ba77e.fits.slist,
>> SLID= 188911, number of sources = 351
>> [harriot] 12:32:17 - Using SourceList
>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5715238-469db9f766ee676aa6253973c5bfdccc58ce31d6.fits.slist,
>> SLID= 188881, number of sources = 338
>> [harriot] 12:32:17 - Using SourceList
>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5773749-5c88eefe9288eaeba6eae6bcec0f501fb92f2be1.fits.slist,
>> SLID= 188901, number of sources = 347
>> [harriot] 12:32:17 - Outer bounding box:
>> (171.39094,-21.70183,171.20449,-21.70183,171.20460,-21.40960,171.39101,-21.40959
>> )
>> [harriot] 12:32:19 - Copied 2526 sources to scratch table
>> [harriot] 12:32:29 - Pairing query found 3672 pairs
>> [harriot] 12:32:29 - Looking for closest pairs
>> [harriot] 12:32:29 - After filtering 3443 pairs remain
>> [harriot] 12:32:33 - Needed 3 loops to combine 3443 pairs into 415
>> associations
>> [harriot] 12:32:33 - Created Matched AssociateList with ALID = 69081, name
>> =
>> GAS-DEEP3a-FR-031;DEEP3a-FR-032;DEEP3a-FR-033;DEEP3a-FR-034;DEEP3a-FR-035-54354.4390938
>> and 415 associates!
>> [harriot] 12:32:34 - RUNNING: asctoldac -i
>> tmp1189506737.415977.OXfhoZ.asctoldac.txt -o
>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5715238-469db9f766ee676aa6253973c5bfdccc58ce31d6.fits.slist.out
>> -c tmp1189506737.415977.OXfhoZ.asctoldac.defs -t OBJECTS -b 1
>> [harriot] 12:32:34 -
!! edited out for brevity (see previous message for original output)
>> [harriot] 12:32:51 - Writing
>> GAS-DEEP3a-FR-031;DEEP3a-FR-032;DEEP3a-FR-033;DEEP3a-FR-034;DEEP3a-FR-035-54354.4390938.alloverlap.png
>> . . .
>> [harriot] 12:32:52 -
>> GAS-DEEP3a-FR-031;DEEP3a-FR-032;DEEP3a-FR-033;DEEP3a-FR-034;DEEP3a-FR-035-54354.4390938
>> inspected.
>> awe>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> On Tue, 11 Sep 2007, Philippe Heraudeau wrote:
>>
>>> Hi John,
>>>
>>> Thanks for you email.
>>> Gastrom now worked on the cluster but I now get an ldac error running
>>> things locally to get the inspect plot (using the awbase version).
>>> Any idea?
>>>
>>> Cheers,
>>> Philippe
>>>
>>>
>>> task = GAstromTask( instrument='WFI' , C=0,
>>> raw_filenames=['WFI.2000-03-30T06:23:02.880_2.fits','WFI.2000-03-30T06:29:29.466_2.fits','WFI.2000-03-30T06:10:13.781_2.fits','WFI.2000-03-30T06:16:37.269_2.fits','WFI.2000-03-30T06:36:06.137_2.fits'],chip='ccd51',inspect=1)
>>> awe> task.execute() [aibn203] 09:12:30 - Querying database for instances
>>> of class ReducedScienceFrame...
>>> [aibn203] 09:12:46 - Using SourceList
>>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5701493-864541ce1b63a1746ebe60f74004c423789992ff.fits.slist,
>>>
>>> SLID = 188891, number of sources = 347
>>> [aibn203] 09:12:47 - Using SourceList
>>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5773749-5c88eefe9288eaeba6eae6bcec0f501fb92f2be1.fits.slist,
>>>
>>> SLID = 188901, number of sources = 347
>>> [aibn203] 09:12:47 - Using SourceList
>>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5740235-773a53b1b092f19ca995a54bfda4e3f8f7a06e08.fits.slist,
>>>
>>> SLID = 188921, number of sources = 315
>>> [aibn203] 09:12:48 - Using SourceList
>>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5715238-469db9f766ee676aa6253973c5bfdccc58ce31d6.fits.slist,
>>>
>>> SLID = 188881, number of sources = 338
>>> [aibn203] 09:12:48 - Using SourceList
>>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5727470-ad8f21d2abb23a04be01c0b2e8e4743e824ba77e.fits.slist,
>>>
>>> SLID = 188911, number of sources = 351
>>> [aibn203] 09:12:50 - Outer bounding box:
>>> (171.39094,-21.70183,171.20449,-21.70183,171.20460,-21.40960,171.39101,-21.40959
>>>
>>> )
>>> [aibn203] 09:13:04 - Copied 2526 sources to scratch table
>>> [aibn203] 09:13:08 - Pairing query found 3672 pairs
>>> [aibn203] 09:13:08 - Looking for closest pairs
>>> [aibn203] 09:13:08 - After filtering 3443 pairs remain
>>> [aibn203] 09:13:12 - Needed 3 loops to combine 3443 pairs into 415
>>> associations
>>> [aibn203] 09:13:12 - Created Matched AssociateList with ALID = 69051,
>>> name =
>>> GAS-DEEP3a-FR-031;DEEP3a-FR-032;DEEP3a-FR-033;DEEP3a-FR-034;DEEP3a-FR-035-54354.3005756
>>>
>>> and 415 associates!
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - ERROR in program with key asctoldac0!
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - Dumping everything (see last dump for terminal
>>> error):
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - ===================================================
>>> [aibn203] 09:13:15 - Basic information for program with key ldac
>>> [aibn203] 09:13:15 - ===================================================
>>> [aibn203] 09:13:15 - NAME: ldac
>>> [aibn203] 09:13:15 - DESCRIPTION: Python wrapper for the Leiden Data
>>> Analysis Center, better known as LDAC
>>> [aibn203] 09:13:15 - VERSION: @(#)$Revision: 1.69 $
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Configuration for program with key ldac:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Warnings for program with key ldac:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Errors for program with key ldac:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Full output for program with key ldac:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - RUNNING: asctoldac -i
>>> tmp1189494766.749547.UFQcyG.asctoldac.txt -o
>>> GAS-Sci-PHERAUDEAU-WFI-------#844-ccd51-Red---Sci-54353.5715238-469db9f766ee676aa6253973c5bfdccc58ce31d6.fits.slist.out
>>>
>>> -c tmp1189494766.749547.UFQcyG.asctoldac.defs -t OBJECTS -b 1
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - ===================================================
>>> [aibn203] 09:13:15 - Basic information for program with key asctoldac0
>>> [aibn203] 09:13:15 - ===================================================
>>> [aibn203] 09:13:15 - NAME: asctoldac
>>> [aibn203] 09:13:15 - DESCRIPTION: None
>>> [aibn203] 09:13:15 - VERSION: None
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 -
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Configuration for program with key asctoldac0:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Warnings for program with key asctoldac0:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Errors for program with key asctoldac0:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - Full output for program with key asctoldac0:
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 - ---------------------------------------------------
>>> [aibn203] 09:13:15 -
>>> Traceback (most recent call last):
>>> File "<stdin>", line 1, in ?
>>> File "/user2/heraud/opipe/DBRecipes/GAstrom.py", line 138, in execute
>>> self.make_global_astrometric_solution()
>>> File "/user2/heraud/opipe/DBRecipes/GAstrom.py", line 177, in
>>> make_global_astrometric_solution
>>> gastrom.make()
>>> File "/user2/heraud/opipe/astro/main/GAstrometric.py", line 81, in make
>>> self.make_global_astrom()
>>> File "/user2/heraud/opipe/astro/main/GAstrometric.py", line 216, in
>>> make_global_astrom
>>> incats, pairscat = self._make_astrom_cats()
>>> File "/user2/heraud/opipe/astro/main/GAstrometric.py", line 239, in
>>> _make_astrom_cats
>>> chip_dict = self._retrieve_astrom_cats()
>>> File "/user2/heraud/opipe/astro/main/GAstrometric.py", line 360, in
>>> _retrieve_astrom_cats
>>> self.ldac.asctoldac(input, outcat, table_defs, 'OBJECTS', clargs='-b
>>> %d' % (channelnr))
>>> File "/user2/heraud/opipe/astro/external/LDAC.py", line 528, in asctoldac
>>> self.run(command, config=None, program=method, verbose=verbose)
>>> File "/user2/heraud/opipe/astro/external/LDAC.py", line 223, in run
>>> raise LDACError, '%s failed' % program_key
>>> astro.external.LDAC.LDACError: asctoldac0 failed
>>>
>>>
>>>
>>>
>>> John P. McFarland wrote:
>>>> Hi Kor and Philippe,
>>>>
>>>> The errors were caused by two typos, one related to somebody else's
>>>> changes merged into my own, and the other just plain stupidity on my
>>>> part. Both are fixed now. I expected that the unittests would have
>>>> caught these errors, but I was very surprised to find there are no
>>>> unittests for GAstrom whatsoever! I'm amazed there were only these
>>>> two errors left over.
>>>>
>>>> GAstrometry appears fine: it runs without error on both of your
>>>> problems Philippe. Please (both of you) test it out to make sure
>>>> there are no other problems.
>>>>
>>>> Cheers,
>>>>
>>>>
>>>> -=John
>>>>
>>>>
>>>> p.s. Please send any future errors like these to the Issues list so that
>>>> everybody is aware and can help with them quickly. Thanks.
>>>>
>>>
>>
>>
>
>
>
More information about the Issues
mailing list