Dear Hugo,<div><br></div><div>thanks for the great work to ingest the catalogs. Here goes the answer to your questions:<br><br><div class="gmail_quote">On Fri, Nov 23, 2012 at 12:20 PM, Hugo Buddelmeijer <span dir="ltr"><<a href="mailto:buddel@astro.rug.nl" target="_blank">buddel@astro.rug.nl</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Nicola,<br>
<br>
As I understood it, there is a first Sextractor run to measure the SEEING_FWHM of the final Sextractor run. It would be useful to ingest these as well. However this does not have priority.<br></blockquote><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Furthermore, I'm not sure which catalog this would be. For every final catalog there are two earlier runs, with the extensions ".cat" and ".cat.1" in the KIDSCAT_INTDR2_52FIELDS directory. From the KIDSCAT readme I figured that the ".cat.1" catalog is the FWHM catalog, correct? </blockquote>
<div><br></div><div>The .cat.1 files are exactly the catalogs produced during first-run, i.e. there is no FWHM optimization, and no 2DPHOT flag column in the catalogs. Pls, lemme know if you need any further info/some modification about this stuff. </div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">What is the difference with the "<ObservingBlockName>.cat" and "<CoaddFilename>.cat"?<br>
<br></blockquote><div><br></div><div>They are the same. I just kept both at the moment, as I was not sure on the best way to rename the catalog files for ingestion. </div><div>I will remove "<ObservingBlockName>.cat" files in the forthcoming versions, OK?</div>
<div><br></div><div>Thanks!!</div><div> </div><div>Francesco</div><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Greetings,<br>
Hugo<div class="HOEnZb"><div class="h5"><br>
<br>
<br>
On 23/11/12 12:10, Nicola R. Napolitano wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Hi Hugo,<br>
<br>
I'm navigating within the catalogs. It works nice! Well done.<br>
<br>
I'm looking at the todo list: what do you mean by intermediate catalogs?<br>
<br>
Cheers,<br>
<br>
Nicola<br>
<br>
<br>
On 11/23/12 11:58 AM, Hugo Buddelmeijer wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Nicola et al.,<br>
<br>
This night I've done a first ingestion of all the 52 catalogs made<br>
with KIDSCAT beta v1.0. They can be found by querying for SourceLists<br>
with the name "INTDR2test_*", like:<br>
awe> slsintdr2 = SourceList.name.like("<u></u>INTDR2test_*")<br>
awe> len(slsintdr2)<br>
52<br>
Or through the dbviewer:<br>
<a href="http://socuteurl.com/funnytumble" target="_blank">http://socuteurl.com/<u></u>funnytumble</a><br>
<br>
They have 'test' in the name because they are simply a conversion from<br>
the .cat files to AW SourceLists. No thorough assessment of the<br>
catalogs are done yet. However, they seem okay, and we will start<br>
using them here.<br>
<br>
What has not yet been done:<br>
- Ingesting the sexconf/sexparams (first thing to do)<br>
- Ingestion of the masks (the weights used are from AW right?)<br>
- Ingestion of the intermediate catalogs<br>
- Ingestion(/recreation) of QC plots<br>
<br>
What happened to the columns:<br>
- FLUX_APER and FLUXERR_APER are renamed to FLUX_APER_<aperturesize><br>
and FLUXERR_APER_<aperturesize>. So FLUX_APER_10 is the flux in a<br>
10 arcsecond aperture.<br>
- The VIGNET columns have been removed.<br>
- Some columns are renamed according to the FITSCOLUMN_NAMES dictionary<br>
in SourceList.py:<br>
<br>
<a href="http://www.astro-wise.org/viewvc/awe/astro/main/SourceList.py?annotate=1.228#l2788" target="_blank">http://www.astro-wise.org/<u></u>viewvc/awe/astro/main/<u></u>SourceList.py?annotate=1.228#<u></u>l2788</a><br>
<br>
- The HTM column is added.<br>
<br>
I will improve the catalog ingestion, starting with the sexconf, since<br>
this will improve the data lineage and reproducebility. If there is<br>
anything wrong, unclear or missing, please notify me!<br>
<br>
Greetings,<br>
Hugo<br>
<br>
P.S. I moved this discussion to <a href="mailto:kids@astro-wise.org" target="_blank">kids@astro-wise.org</a>, that way everyone<br>
gets them. Contact Gijs if you're not on this list yet.<br>
<br>
<br>
<br>
On 21/11/12 10:48, Nicola R. Napolitano wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
I forgot to include Francesco in the mailing list....reply to this<br>
message if needed.<br>
<br>
Cheers,<br>
<br>
Nicola<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi everyone,<br>
<br>
the catalogs for the 52 coadds selected for the INT-DR2 have been<br>
produced using KIDSCAT beta v1.0 and current products can be<br>
downloaded at the following link<br>
<br>
<a href="http://vstportal.oacn.inaf.it/KIDSCAT/KIDSCAT_INTDR2_52FIELDS/" target="_blank">http://vstportal.oacn.inaf.it/<u></u>KIDSCAT/KIDSCAT_INTDR2_<u></u>52FIELDS/</a><br>
<br>
We have started to have a visual check to the catalogs in order to<br>
have a firs catalog QC before these are passed/ingested to AW for the<br>
QC of the coadds. In particular we are concentrating to the following<br>
checks:<br>
<br>
1) look at the plot FWHM vs SNR in the PLOTS directory (Check that<br>
there is only one stellar sequence and that the spread is reasonably<br>
within a couple of pixels. Check that there are no weird features like<br>
clouds of points at low FWHM - e.g. satellite tracks?)<br>
2) in the same directory there are now also the mag limit plots right<br>
implemented from Francesco (mag lim estimates are in<br>
OUTPUT_RES/MLIM.dat, see also Francesco's message);<br>
3) look at a 2D X-Y plot of all sources versus the ones with col7<br>
(IMAFLAGS_ISO) <1 "bona fide" sources to see whether the distribution<br>
is uniform and cross-check with the fits image to see whether the<br>
major stars are correctly masked;<br>
4) plot flux_radius (col9) vs mag_auto (col15) for an independent<br>
check of the stellar sequences;<br>
5) report comments on the test above in a table with the following<br>
columns:<br>
#FIELD; BAND; FWHM vSNR; 2Dplot; 2Dflag0 plot; visual vs ds9;<br>
fluxRvsmag_A; extraComm<br>
<br>
I'll gather all you comments and I'll put in a table which will posted<br>
on the wiki<br>
<br>
<a href="http://wiki.astro-wise.org/projects:kids:data_deliveries:internaldelivery2.0_scratch#quality_check_of_the_52_catalog_for_int-dr2" target="_blank">http://wiki.astro-wise.org/<u></u>projects:kids:data_deliveries:<u></u>internaldelivery2.0_scratch#<u></u>quality_check_of_the_52_<u></u>catalog_for_int-dr2</a><br>
<br>
<br>
Cheers,<br>
<br>
Nicola<br>
<br>
--<br>
Nicola R. Napolitano<br>
Research Astronomer<br>
INAF - Observatory of Capodimonte<br>
Salita Moiariello, 16, 80131, Napoli (Italy)<br>
phone: <a href="tel:%2B39%20081%205575509" value="+390815575509" target="_blank">+39 081 5575509</a>; fax: <a href="tel:%2B39%20081%20456710" value="+39081456710" target="_blank">+39 081 456710</a><br>
<a href="mailto:email%3Anapolita@na.astro.it" target="_blank">email:napolita@na.astro.it</a> <mailto:<a href="mailto:napolita@na.astro.it" target="_blank">napolita@na.astro.it</a>><br>
web page:<a href="http://www.na.astro.it/~napolita" target="_blank">http://www.na.astro.it/~<u></u>napolita</a><br>
<<a href="http://www.na.astro.it/%7Enapolita" target="_blank">http://www.na.astro.it/%<u></u>7Enapolita</a>><br>
</blockquote>
<br>
<br>
--<br>
Nicola R. Napolitano<br>
Research Astronomer<br>
INAF - Observatory of Capodimonte<br>
Salita Moiariello, 16, 80131, Napoli (Italy)<br>
phone: <a href="tel:%2B39%20081%205575509" value="+390815575509" target="_blank">+39 081 5575509</a>; fax: <a href="tel:%2B39%20081%20456710" value="+39081456710" target="_blank">+39 081 456710</a><br>
<a href="mailto:email%3Anapolita@na.astro.it" target="_blank">email:napolita@na.astro.it</a> <mailto:<a href="mailto:napolita@na.astro.it" target="_blank">napolita@na.astro.it</a>><br>
web page:<a href="http://www.na.astro.it/~napolita" target="_blank">http://www.na.astro.it/~<u></u>napolita</a><br>
<br>
</blockquote>
<br>
</blockquote>
<br>
<br>
</blockquote>
<br>
</div></div></blockquote></div><br></div>