Odd ASTAP stacking bug

Questions, support and discussions
szymon
Posts: 28
Joined: 29 Aug 2019, 18:17

Odd ASTAP stacking bug

Post by szymon » 25 Sep 2019, 18:30

Every now and again when stacking mono files in ASTAP, I see a message that I am actually stacking data from an OSC and that I should enable debayering (I don't have the actual message to hand right now, will append to here if I see it). To be clear, this only happens when I use Astrometric Alignment in the Alignment tab, I've not seen it happen when using Star alignment. It happens on both Windows and MacOS.

When this happens, stacks come out all black (literally, the min and max values are 0 and 1), and I have to restart ASTAP to be able to stack again without seeing the message.

On the next stack after restarting, I see the following:

Code: Select all

Move file /personal/BUBBLE_BRAIN/4kgain_Oiii/2019-09-02_00-37-56_Oiii_13.10_300.00s_1.fits to tab FLATS
I look at that file (which was a genuine light) and it has been overwritten with an all black file (thankfully a .bak file is created), and the type of image has indeed been changed in the FITS header to:

Code: Select all

IMAGETYP= 'FLAT'               / Type of exposure                               
The file which has been modified is here:

https://www.dropbox.com/s/v85phh30zra0n ... .fits?dl=1

The next time I see this, I will save the full log and try to upload all of the data for you to look at.

Many thanks,

-simon

han.k
Posts: 291
Joined: 23 Nov 2017, 15:04
Location: The Netherlands
Contact:

Re: Odd ASTAP stacking bug

Post by han.k » 25 Sep 2019, 19:29

Hello Simon,

Thanks for your feedback. At the moment, I can't say much. If it happens again, see if the problem is repeatable. Then it possible to trace the cause.

Clear skies, Han

szymon
Posts: 28
Joined: 29 Aug 2019, 18:17

Re: Odd ASTAP stacking bug

Post by szymon » 25 Sep 2019, 19:32

Has happened a few times, I will try and reproduce and save the log entries for you.

szymon
Posts: 28
Joined: 29 Aug 2019, 18:17

Re: Odd ASTAP stacking bug

Post by szymon » 27 Sep 2019, 03:32

Ok, here's an example -- it just happened again. Notice the message about OSC being stacked as monochrome -- there is no OSC here. The rest of the stack goes badly (I don't have flats selected, and none of the files can be aligned).

What do I need to provide so that you can debug this?

Code: Select all

02:26:27  Stack method Sigma clip average
02:26:27  Oversize 0
02:26:27  Analysing images.
02:26:27  Stacking (Sigma clip average), HOLD ESC key to abort.
02:26:27  Analysing darks.
02:26:27  Analysing flats.
02:26:27  █ █ █ █ █ █ Warning, OSC image is stacked as monochrome! Check mark convert OSC to colour. █ █ █ █ █ █
02:26:30  Loading master dark file C:\TARGETS\WIZARD\DAY1\DARK\master_dark_23x300s_at_14C.fit
02:26:32  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:26:32  Adding light file: 1-10 "C:\IMAGES\LIGHT\2019-09-27_01-28-11_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_7.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:26:41  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:26:41  Adding light file: 2-10 "C:\IMAGES\LIGHT\2019-09-27_01-11-47_NGC 7380 Panel 0_Sii_14.70_4000.00_40.00_1x1_300.00s_4.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:26:46  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:26:47  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:26:47  Adding light file: 3-10 "C:\IMAGES\LIGHT\2019-09-27_01-17-07_NGC 7380 Panel 0_Sii_14.70_4000.00_40.00_1x1_300.00s_5.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:26:53  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:26:54  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:26:54  Adding light file: 4-10 "C:\IMAGES\LIGHT\2019-09-27_01-22-42_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_6.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:01  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:27:02  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:02  Adding light file: 5-10 "C:\IMAGES\LIGHT\2019-09-27_01-06-47_NGC 7380 Panel 0_Sii_14.50_4000.00_40.00_1x1_300.00s_3.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:08  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:27:10  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:10  Adding light file: 6-10 "C:\IMAGES\LIGHT\2019-09-27_01-33-50_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_8.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:16  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:27:18  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:18  Adding light file: 7-10 "C:\IMAGES\LIGHT\2019-09-27_01-39-12_NGC 7380 Panel 0_Sii_14.50_4000.00_40.00_1x1_300.00s_9.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:25  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:27:27  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:27  Adding light file: 8-10 "C:\IMAGES\LIGHT\2019-09-27_01-44-39_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_10.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:32  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:27:34  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:34  Adding light file: 9-10 "C:\IMAGES\LIGHT\2019-09-27_01-50-07_NGC 7380 Panel 0_Sii_14.50_4000.00_40.00_1x1_300.00s_11.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:40  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:27:41  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:41  Adding light file: 10-10 "C:\IMAGES\LIGHT\2019-09-27_01-55-50_NGC 7380 Panel 0_Sii_14.80_4000.00_40.00_1x1_300.00s_12.fits dark compensated to light average. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:47  Not enough tetrahedron matches <3 or inconsistent solution, skipping this image.
02:27:49  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:49  Calculating pixels σ of light file 1-10 C:\IMAGES\LIGHT\2019-09-27_01-28-11_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_7.fits Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:27:54  █ █ █ █ █ █ Warning, could not find a suitable flat for "Sii"! De-classify or add correct flat. █ █ █ █ █ █ 
02:27:54  Combining 1-10"C:\IMAGES\LIGHT\2019-09-27_01-28-11_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_7.fits", ignoring outliers. Using 23 dark(s), 0 flat(s), 0 flat-dark(s)
02:28:03  █ █ █  Saving result 10 as C:\IMAGES\LIGHT\2019-09-27_01-28-11_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_7  0xFD  0xF  23xD  0x0R  0x0G  0x0B  0x0RGB  1x300L  _stacked.fit
Finished in 97 sec. The FITS header contains a detailed history.[code]
[/code]

han.k
Posts: 291
Joined: 23 Nov 2017, 15:04
Location: The Netherlands
Contact:

Re: Odd ASTAP stacking bug

Post by han.k » 01 Oct 2019, 13:08

Hello Simon,

The resulting file goes to the correct new file name:
2019-09-27_01-28-11_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_7 0xFD 0xF 23xD 0x0R 0x0G 0x0B 0x0RGB 1x300L _stacked.fit

The stacking routine can't find a match. What could happen is that the reference file is poor. The first file is the reference file:
2019-09-27_01-28-11_NGC 7380 Panel 0_Sii_14.60_4000.00_40.00_1x1_300.00s_7.fits

It select automatically the image with the lowest HFD value as reference. If for example the tracking is lost it comes out as streaks with low amount of stars detection and a low HFD. So best thing to do is to check this file used as reference. In general you should check not only too high HFD values but also too low HFD values. Prior to stacking, I sort on HFD, number of stars detected and star level and check them visually prior to stacking

Try again, and if it doesn't work, give me the set for testing

The warning "image is stacked as monochrome!" doesn't do harm. The detection is not working properly for your fits. I will try to improve it. If you have a sample file that could help.

Clear skies, Han

han.k
Posts: 291
Joined: 23 Nov 2017, 15:04
Location: The Netherlands
Contact:

Re: Odd ASTAP stacking bug

Post by han.k » 01 Oct 2019, 16:48

In version 0.9.275, I have improved OSC sensor detection (statistically). Hopefully this should not give a false warning.

Clear skies, Han

szymon
Posts: 28
Joined: 29 Aug 2019, 18:17

Re: Odd ASTAP stacking bug

Post by szymon » 19 Nov 2019, 14:34

Hi Han,

Just logged on to confirm that I've tested with the same camera last night (after a long period of cloudy skies!) and the problem has indeed gone away in the latest version of ASTAP :-)

Cheers,

-simon

Post Reply