<html><head></head><body><p dir=ltr>The ingestion is ongoing! I will give an estimated time for completion as soon as I have one.</p>
<p dir=ltr>And I suppose by then we will continue with the next batch already ;-)<br>
</p>
<br><br><div class="gmail_quote">Francesco La Barbera <flabarber@gmail.com> schreef:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div dir="ltr">HI Hugo, <div><br /></div><div>no changes at all since 22:00 last time. Pls, go ahead with ingestion !!!<div><br /></div><div style="style">cheers,</div><div style="style">F.</div><div style="style"><br /></div></div></div><div class="gmail_extra">
<br /><br /><div class="gmail_quote">On Thu, Apr 18, 2013 at 7:45 AM, Hugo Buddelmeijer <span dir="ltr"><<a href="mailto:buddel@astro.rug.nl" target="_blank">buddel@astro.rug.nl</a>></span> wrote:<br /><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Thanks Francesco!<br />
<br />
Did anything change since about 22:00 last night?<br />
<br />
I went to bed at about that time and noticed that the files were there, so I went ahead and started downloaded them anyway before receiving your email.<br />
<br />
To be certain, I'm downloading the files again. However, I'll start ingesting the files I downloaded last night if you say that there have been no changes.<br />
<br />
Hugo<div class="im"><br />
<br />
On 04/17/2013 11:04 PM, Francesco La Barbera wrote:<br />
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
Dear All,<br />
<br />
the sourcelists have been created with the latest masks that Mario<br />
passed us.<br />
<br />
Hugo, pls go ahead with ingestion from the same link as last time:<br />
<br />
<a href="http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/" target="_blank">http://vstportal.oacn.inaf.it/<u></u>KIDSCAT/ESO_DR1_kc1.6/</a><br />
<br />
As usual, I checked that all data products/plots are in the proper place<br />
for each coadd.<br />
<br />
Cheers,<br />
Francesco<br />
<br />
<br />
<br />
On Wed, Apr 10, 2013 at 2:53 PM, Francesco La Barbera<br /></div><div class="im">
<<a href="mailto:flabarber@gmail.com" target="_blank">flabarber@gmail.com</a> <mailto:<a href="mailto:flabarber@gmail.com" target="_blank">flabarber@gmail.com</a>>> wrote:<br />
<br />
Dear All,<br />
<br />
I'm happy to inform you that the new sourcelists have been produced now.<br />
<br />
Hugo, you can access them for AW ingestion at the same link as last<br />
time, i.e.<br />
<br />
<a href="http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/" target="_blank">http://vstportal.oacn.inaf.it/<u></u>KIDSCAT/ESO_DR1_kc1.6/</a><br />
<br />
I checked that all files are in place, and there was no evident<br />
issue with all different data products.<br />
The sourcelists have been generated with the new, latest, masks<br />
passed me by Mario and Nicola,<br />
and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity<br />
estimates).<br />
<br />
Pls, lemme know if everything is OK with this.<br />
<br />
Cheers,<br />
Francesco<br />
<br />
<br />
<br />
<br />
On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn<br /></div><div class="im">
<<a href="mailto:verdoes@astro.rug.nl" target="_blank">verdoes@astro.rug.nl</a> <mailto:<a href="mailto:verdoes@astro.rug.nl" target="_blank">verdoes@astro.rug.nl</a>>> wrote:<br />
<br />
Dear Nicola and Mario and Hugo,<br />
<br />
How is the automated mask + sourcelist production going?<br />
<br />
I am now coordinating the visual grading and manual mask production.<br />
My plan is to have that team start to work on all coadds at<br />
is_valid=1 and 2 asap.<br />
(NB: all coadds that will be re-processed this week are now set<br />
to is_valid=0)<br />
<br />
As far as I see this effort is decoupled (enough) from your<br />
mask+sourcelist effort and there can start now. I will tell the<br />
manual mask team to anticipate improvement on the current<br />
automated masks. And hence start no manually improving those.<br />
<br />
Please let me know if you see problems with this decoupled<br />
parallel effort.<br />
<br />
Best wishes, Gijs<br />
<br />
<br />
<br />
On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:<br />
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
<br />
OK Lino. Thanks<br />
<br />
N<br />
<br />
<br />
<br />
On 4/8/13 8:41 PM, aniello grado wrote:<br />
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
Hi Nicola,<br />
<br />
the manual masks are on beo3 in the dir:<br />
<br />
/opt/AW/current/astro/<u></u>experimental/kids/regionfiles<br />
<br />
Lino<br />
<br />
<br />
On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano<br /></div><div class="im">
<<a href="mailto:napolita@na.astro.it" target="_blank">napolita@na.astro.it</a> <mailto:<a href="mailto:napolita@na.astro.it" target="_blank">napolita@na.astro.it</a>>> wrote:<br />
<br />
<br />
Hi Lino,<br />
<br />
automatic masking is about to start. Mario and I are<br />
still struggling with the g-band but we should be able to<br />
work this out by the end of the day.<br />
Meanwhile r,i,u are ready to go after we have checked the<br />
spike length, which needs just some more very short<br />
visual test.<br />
This means that auto-masks will be possibly ready<br />
tomorrow morning.<br />
<br />
To start the sourcelists extraction, though, we need to<br />
incorporate the manual masks into the auto masks, since<br />
the idea is to provide a unique flag in the catalogs.<br />
Thus we need to know whether the final manual masks are<br />
also ready for the download. If so please give to Mario<br />
the necessary references for that.<br />
<br />
Cheers,<br />
<br />
Nicola<br />
<br />
On 4/6/13 3:55 PM, aniello grado wrote:<br />
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
Hi Mario and Nicola,<br />
<br />
the coadds are ready for automatic masking.<br />
<br />
Lino<br />
<br />
---------- Forwarded message ----------<br />
From: <<a href="mailto:jelte@strw.leidenuniv.nl" target="_blank">jelte@strw.leidenuniv.nl</a><br /></div><div class="im">
<mailto:<a href="mailto:jelte@strw.leidenuniv.nl" target="_blank">jelte@strw.leidenuniv.<u></u>nl</a>>><br />
Date: Sat, Apr 6, 2013 at 2:24 PM<br />
Subject: Re: reprocessing and is_valid = 1 coadds<br />
To: Gijs Verdoes Kleijn <<a href="mailto:verdoes@astro.rug.nl" target="_blank">verdoes@astro.rug.nl</a><br /></div><div><div class="h5">
<mailto:<a href="mailto:verdoes@astro.rug.nl" target="_blank">verdoes@astro.rug.nl</a>>><u></u>, Lino Grado<br />
<<a href="mailto:agrado@na.astro.it" target="_blank">agrado@na.astro.it</a> <mailto:<a href="mailto:agrado@na.astro.it" target="_blank">agrado@na.astro.it</a>>><br />
<br />
<br />
Hi Gijs and Lino,<br />
<br />
just to let you know that reprocessing is done now.<br />
We now have again 200 DR1 coadds:<br />
<br />
awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'<br />
awe> list =<br />
[CoaddedRegriddedFrame(object_<u></u>id=c.db_object_id) for c<br />
in query]<br />
awe> len(list)<br />
200<br />
<br />
The total number of reprocessed coadds is 50:<br />
awe> query = Comment.content ==<br />
'KiDS-ESO-DR1-Coadd-<u></u>Reprocessed-After-QA1'<br />
awe> list =<br />
[CoaddedRegriddedFrame(object_<u></u>id=c.db_object_id) for c<br />
in query]<br />
awe> len(list)<br />
50<br />
<br />
Querying for the comment 'KiDS-ESO-DR1-Coadd-DISCARDED'<br />
will also give 50<br />
coadds, namely the ones replaced by the reprocessed coadds.<br />
<br />
From the 74 is_valid=0 coadds, 24 were not reprocessed<br />
since according to<br />
the reprocessing teams there was no improvement<br />
possible. These coadds<br />
that are retained in DR1 can be recognized by the comment<br />
'KiDS-ESO-DR1-Coadd-Retained-<u></u>After-QA1':<br />
<br />
awe> query = Comment.content ==<br />
'KiDS-ESO-DR1-Coadd-Retained-<u></u>After-QA1'<br />
awe> list =<br />
[CoaddedRegriddedFrame(object_<u></u>id=c.db_object_id) for c<br />
in query]<br />
awe> len(list)<br />
24<br />
<br />
Cheers,<br />
Jelte<br />
<br />
> Hi Gijs and Lino,<br />
><br />
> reprocessing is almost done.<br />
> There were still 3 coadds that needed to be<br />
reprocessed and that is<br />
> currently being done.<br />
> Over the weekend I will update their comments etc, and<br />
notify Mario so<br />
> he can download the new ones for source extraction.<br />
><br />
> I have also put a table on the wiki with the coadds<br />
that were set to<br />
> is_valid = 1 during the visual inspection (QA1):<br />
><br />
<a href="http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1" target="_blank">http://wiki.astro-wise.org/<u></u>projects:kids:data_deliveries:<u></u>kids-eso-dr1:<u></u>productiondashboard#coadd_set_<u></u>to_is_valid_1_during_qa1</a><br />
> Also included in the table (where it was clear to me)<br />
is the reasons why<br />
> the visual inspection team thinks these coadds could<br />
be improved if<br />
> there is enough time.<br />
> We should set up a dedicated team that can have a look<br />
at these coadds<br />
> next week to see which ones can be improved by<br />
reprocessing.<br />
> In any case our goal should be to have all final<br />
coadds by next Friday<br />
> (April 12).<br />
><br />
> Cheers,<br />
> Jelte<br />
><br />
> --<br />
> Dr. Jelte T. A. de Jong<br />
> KiDS project manager<br />
> Sterrewacht Leiden<br />
> Leiden University, Leiden, the Netherlands<br />
> E: <a href="mailto:jelte@strw.leidenuniv.nl" target="_blank">jelte@strw.leidenuniv.nl</a><br /></div></div><div class="im">
<mailto:<a href="mailto:jelte@strw.leidenuniv.nl" target="_blank">jelte@strw.leidenuniv.<u></u>nl</a>><br />
> T: <a href="tel:%2B31-%280%29715275818" value="+31715275818" target="_blank">+31-(0)715275818</a> <tel:%2B31-%280%29715275818><br />
> W: <a href="http://jelte.jdejong.net" target="_blank">jelte.jdejong.net</a> <<a href="http://jelte.jdejong.net" target="_blank">http://jelte.jdejong.net</a>><br />
><br />
><br />
<br />
<br />
<br />
<br /></div><div class="im">
--<br />
<<<<<<<<<<<<<<<<<<<<>>>>>>>>>><u></u>>>>>>>>>>>><br />
<br />
Aniello Grado, PhD<br />
<br />
Ricercatore Astronomo<br />
INAF- Osservatorio Astronomico di Capodimonte<br />
Via Moiariello 16 80131 Napoli<br />
ITALIA<br /></div><div class="im">
Tel: <a href="tel:0039%200815575547" value="+390815575547" target="_blank">0039 0815575547</a> <tel:0039%200815575547><br />
Fax: <a href="tel:0039%200815575433" value="+390815575433" target="_blank">0039 0815575433</a> <tel:0039%200815575433><br />
<br />
<<<<<<<<<<<<<<<<<<<<>>>>>>>>>><u></u>>>>>>>>>>>><br />
</div></blockquote>
<br />
<br /><div class="im">
--<br />
Nicola R. Napolitano<br />
Research Astronomer<br />
INAF - Observatory of Capodimonte<br />
Salita Moiariello, 16, 80131, Napoli (Italy)<br /></div><div class="im">
phone:<a href="tel:%2B39%20081%205575509" value="+390815575509" target="_blank">+39 081 5575509</a> <tel:%2B39%20081%205575509>; fax:<a href="tel:%2B39%20081%20456710" value="+39081456710" target="_blank">+39 081 456710</a> <tel:%2B39%20081%20456710><br />
</div>
<a href="mailto:email%3Anapolita@na.astro.it" target="_blank">email:napolita@na.astro.it</a> <mailto:<a href="mailto:napolita@na.astro.it" target="_blank">napolita@na.astro.it</a>><br />
web page:<a href="http://www.na.astro.it/~napolita" target="_blank">http://www.na.astro.it/~<u></u>napolita</a> <<a href="http://www.na.astro.it/%7Enapolita" target="_blank">http://www.na.astro.it/%<u></u>7Enapolita</a>><div class="im">
<br />
<br />
<br />
<br />
<br />
--<br />
<<<<<<<<<<<<<<<<<<<<>>>>>>>>>><u></u>>>>>>>>>>>><br />
<br />
Aniello Grado, PhD<br />
<br />
Ricercatore Astronomo<br />
INAF- Osservatorio Astronomico di Capodimonte<br />
Via Moiariello 16 80131 Napoli<br />
ITALIA<br /></div><div class="im">
Tel: <a href="tel:0039%200815575547" value="+390815575547" target="_blank">0039 0815575547</a> <tel:0039%200815575547><br />
Fax: <a href="tel:0039%200815575433" value="+390815575433" target="_blank">0039 0815575433</a> <tel:0039%200815575433><br />
<br />
<<<<<<<<<<<<<<<<<<<<>>>>>>>>>><u></u>>>>>>>>>>>><br />
</div></blockquote>
<br />
<br /><div class="im">
--<br />
Nicola R. Napolitano<br />
Research Astronomer<br />
INAF - Observatory of Capodimonte<br />
Salita Moiariello, 16, 80131, Napoli (Italy)<br /></div><div class="im">
phone:<a href="tel:%2B39%20081%205575509" value="+390815575509" target="_blank">+39 081 5575509</a> <tel:%2B39%20081%205575509>; fax:<a href="tel:%2B39%20081%20456710" value="+39081456710" target="_blank">+39 081 456710</a> <tel:%2B39%20081%20456710><br />
</div>
<a href="mailto:email%3Anapolita@na.astro.it" target="_blank">email:napolita@na.astro.it</a> <mailto:<a href="mailto:napolita@na.astro.it" target="_blank">napolita@na.astro.it</a>><br />
web page:<a href="http://www.na.astro.it/~napolita" target="_blank">http://www.na.astro.it/~<u></u>napolita</a> <<a href="http://www.na.astro.it/%7Enapolita" target="_blank">http://www.na.astro.it/%<u></u>7Enapolita</a>><br />
</blockquote><div class="im">
<br />
--<br />
------------------------------<u></u>------------------------------<u></u>--------<br />
|dr Gijs Verdoes Kleijn | astronomer |<br /></div>
|<a href="mailto:e-mail%3Averdoes@astro.rug.nl" target="_blank">e-mail:verdoes@astro.rug.nl</a> <mailto:<a href="mailto:verdoes@astro.rug.nl" target="_blank">verdoes@astro.rug.nl</a>> | OmegaCEN / Kapteyn Institute / |<br />
|www:<a href="http://www.astro.rug.nl/~verdoes" target="_blank">www.astro.rug.nl/~verdoes</a> <<a href="http://www.astro.rug.nl/~verdoes" target="_blank">http://www.astro.rug.nl/~<u></u>verdoes</a>> | Target |<br />
|tel:<a href="tel:%2B31-50-3638326" value="+31503638326" target="_blank">+31-50-3638326</a> <tel:%2B31-50-3638326> | University of Groningen |<br />
|mobile:<a href="tel:%2B31-654658050" value="+31654658050" target="_blank">+31-654658050</a> <tel:%2B31-654658050> | postal address: |<div class="im"><br />
| | Kapteyn Astronomical Institute |<br />
| | Postbus 800, 9700 AV, Groningen|<br />
| | The Netherlands |<br />
------------------------------<u></u>------------------------------<u></u>--------<br />
<br />
<br />
<br />
</div></blockquote>
<br />
</blockquote></div><br /></div>
</blockquote></div></body></html>