Category Archives: Software

Monitoring: Visualizing with free Tableau Public Software

Part of a multi-channel monitoring of the HFGCS net in ALE on July 14, 2019: the vertikal axis shows the channel, the horizontal axis the time of monitoring.

2019 is the year of groundbreaking Software-defined radios, covering the whole HF range of 30 MHz width and recording it for many hours, e.g. from midnight to midnight. In combination with proper software, this allows for a fresh view onto monitoring.

For the screenshot on the top, I had monitored nine HFGCS channels from 3137 kHz to 23327 kHz in parallel (the 18003 kHz didn’t work, sorry) with Winradio’s SIGMA SDR, running with Simon Brown’s free software SDRC V3 and nine instances of MultiPSK decoder.

After automatic monitoring, I harvested all time-stamped logs stripped them from information not needed, and imported them to free Tableau Public software to visualize activity according to station, time and channel. This gives an overview on the monitoring session, propagation, time sequences of hopping from channel to channel etc. – you might zoom into the screenshot for a clearer look.

Thanks to Tableaus also stunning geospatial features, completely other views of the same log are available. The screenshot below shows the number of logs on all channels of a monitoring session of 12 hours.

Geospatial information of the stations, combined with the number of log entries on all channels.

You may zoom into this OSM[ap], and you may also have a zoomed satellite view (or this or that) which directly hits the feeder point of your antenna … if you know the exact location and this is a part of your log entry – see screenshot below.

Zooming the map above onto JDG at satellite view, directly leads you to the location of the station – here Diega Garcia US Military base.

The most versatile Tableau software also allows to relaize many other ideas to visualize monitoring; some of them already above horizon, others still below. To conclude this entry, I did a visualization of all HF stations/channels of AFAD, the Turkish Disaster and Emergency Management Authority, heard by me over the last 18 months. Each (?) of the 81 Turkish provinces maintains an AFAD base, and all (most?) of them are communicating on HF. As Tableau has many detailed geographical already aboard, a visualization of channels/province being heard is easy.

Analyzing part of a logbook: All Turkish provinces heard with ALE signals of AFAD are colored – the deeper the color, the more channels were received in the last 18 months.

Dream Team: Winradio’s SIGMA and Simon’s Software (1)

All main six GMDSS channels on HF at once: Winradio’s SIGMA with Simon Brown’s software SDRC V3

Some days ago, I wrote about my very first experiences with Winradio’s groundbreaking SIGMA SDR receiver, covering e.g. the whole HF band with 32 MHz width and 16 bit resolution – plus much, much more. SIGMA comes with a fine software, and provides an API.dll for connection to 3rd-party software. Thankfully, Simon Brown, G4ELI, adapted his unique SDRC V3 software to this (and other) Winradio in nearly no time.

This combination has become a real dream team: the best hardware and the best software avalaible. The screenshot at the top shows just one example of others which will follow: I made a 24 hour recording of 0 to 25 MHz (7.85TB) and placed six demodulators on the main GMDSS channels on HF between 2 and 16 MHz. You see each channel in a separate window at the top of the screenshot, showing spectrum and spectrogram with time stamps of the recording. Below those six channels you see spectrum and spectrogram of the whole recorded bandwidth, namely 25 MHz. Eventually, below this spectrogram you see 60 x 24 boxes, one for every minute of the 24 hours recording. Just click into the time you want, and the recording instantaneoulsy to it.

Demodulated audio is guided via VAC1 … VAC6 to six different instances of the free YAND GMDSS decoder – see screenshot at the bottom.

There are great many other applications of this revolutionary combination to which I will come back later.

Parallel reception & decoding of six GMDSS channels at once.

ALE [MIL-STD-188-141A]: Which one is the best Decoder?

This is an update from my post two days ago. I have expanded the number of test signals and added some hints.

Does your decoder read this track? Buried in noise and plagued by multipath fading, the recordings below will separate the wheat from the whaff.

Often I am asked – and sometimes even asking myself! – “Which one is the best decoder for ALE?” This means: Which one delivers the best decoding under demanding conditions?

To test this, I made a recording of twelve stations “on the air” plus one weak signal, buried in Additive White Gaussian Noise, AWGN. All signals are correctly tuned, no one invers. All were read by at leastby one of my decoders “in a row”.

To test your decoders, you should download this WAV file of 131 seconds length and play it. It can be either directly opened by some decoder, or feed it via virtual audio cable (VAC) into a decoder. I used Audacity for this.

I am as interested in the results as you are – so please drop me a line to dk8ok [at] gmx.net. I like to encourage you to try all ALE decoders you have at hand – the more, the better.

Already the first results were surprising. This concerned both, the decoding ability of the decoders and the repeatability of the test. So far, the following decoders had participated: go2monitor, Krypto500, MARS-ALE, MultiPSK, Sorcerer, and W-Code. Steve, N2CKH, had written some valuable hints to optimize his MARS-ALE software for SIGINT purposes – please see his comment.


This WAV file contains the calls of thirteen ALE stations. Download and save this file (point to the icon, press right mouse button …). Then feed it to your decoders. Copy the results and send them to me. Have fun!

Visualizing HF Networks

G-VIFT

A flight of G-VFIT from Atlanta to Heathrow, and its HFDL communications – visualized by GEPHI.

Gephi does it

Each communications has a structure. Visualization reveals this structure. This is also valid for HF communications with its networks with different stations, (even moving) locations, hierarchy …

Recently, I made my first steps with free visualization software GEPHI to get a deeper look into some aeronautical networks. The graph at the top shows the gephi’ed result of 125+ HFDL messages, transmitted by a flight of G-VFIT from Atlanta to Heathrow. I monitored six HFDL channels in parallel, one channel from New York, two from Shannon, and three from Reykjavik.

Each point represents a message, tagged by its time in UTC. The positions of the points are geo-referenced, as I used HFDL messages containing these information.

Wheras the longitude’s positions are to scale, their latitude’s positions had been spread for better reading.

This visualization shows that Reykjavik on 6.712 kHz did the main work. But it is surprising that the first contact just leaving the U.S. coast was made with Shannon, and not with nearby New York.

GEPHI also helps in visualizing the hiearchy of networks, see screenshot below:


In the Russian Aero Net on 4.712 kHz, Rostov plays a pivotal role.

Here the strength of the connecting lines and the position of the city’s names represents to hierarchy of this network, i.e. who is calling whom, and how often. There are several strongholds like Rostov, Yekaterinburg and Samara, but also some mere outposts like Novosibirsk and Syktyvkar.

This picture isn’t geo-, but social-referenced, to say so: you know that e.g. Chelyabinsk on the left is geographically situated east of Rostov. You may also geo-reference these data, turn it into a kml file and see it in Google Maps of Open Street Map. If the co-ordinates are correct, zooming will take you exactly to the feeding point of each of their Nadenenko dipole, see below …

The above visualized hierarchy has been changed here into a geo-referenced kml file, opened in Google Earth.

There are many more applications of such a great tool for visualization which will further enrich monitoring.

GMDSS & Display Launcher: Monitoring seven Channels in parallel

DiplayLauncher_4

GMDSS-Display reading decoded data streams from seven MultiPSK’s instances in parallel, presenting all information neatly in one database.

GMDSS is a system of ship-coast and coast-ship digital communications on six main HF channels. At an average location in Germany, you will receive about 5000 messages altogether during 24 hours.

In the past, I mostly used the excellent and free YaDD software to decode all channels in parallel (yes, YaDD can be opened in multi instances, each one in a separate folder).

During HFDL monitoring, I came across Mike Simpson’s free software Display Launcher which neatly collects now up to 24 different data streams, coming from up to 24 HFDL channels in a clear database format.
Mike’s software also contains a module called “GMDSS-Display” which now works similar in collecting datastream from up to seven GMDSS data streams, decoded by MultiPSK software.

Yes, also MultiPSK can be opened in many instances, each one in a sperate folder. By this way, it accepts e.g. the audio input of seven different GMDSS channels from an SDR via each different VACs, and decodes each of them.
To do so, the decoded data of each MultiSPK instance has to be backed up regularly:
Configuration -> Regular back-up -> 20 sec
Then, decoded data is automatically written into the appropriate QSO.txt file. This, in turn, is read by GMDSS-Display. Of course you first have to set the paths to guide the software to the appropriate sources.

It takes a bit time of setting it all up, but then you may run this combination until a Windows’ update forces the PC to re-boot 😉

With Mike’s development, you have a unique and mighty tool at hand for a 360° view now also in the field of GMDSS – thank you very much!

Please find below the results of a 24 hours’ session on all seven GMDSS HF channels – coast stations only, automatically drawn onto DX Atlas. All stations received in Germany with SDR FDM-S2 and MD300DX, an active vertical Megadipole of just 2 x 2.5 m of stunning performance.

DXAtlas_5

Received coastal stations on all GMDSS channel/HF during 24 hours in Germany world-wide and …

DXAtlas_6

… those with a focus onto Europe.

TDoA Direction Finding: First Experiences on the KiwiSDR Net

6465_5

With some iteration, as described in the PDF, the former unknown site of a CIS-12 transmission on 6.465 kHz has been disclosed as the Russian Navy from Baltysk, Kaliningrad.

The stunning direction finding tool on the KiwiSDR net has hit the community. Most people are enthusiastic about the new horizons, some some smart people had opened for free.

A few people, however, reported some disappointment as they couldn’t pinpoint each and every transmitter with expected high precision.

To avoid this disappointment, you have to know what you are doing. The TDoA tool for direction finding indeed delivers automatically stunning results. But you have to think a bit about the setup, and also do some iteration.

I wrapped up my first experiences with TDoA in this PDF. You may simply download it by double-clicking the link, and open it in a PDF reader. It consists of 22 pages and 37 instructive figures. I greatly stressed the practical part of direction finding with this tool – with 13 explicit case studies from 2,6 MHz to 15,6 MHz.

The idea is to have more fun by getting the most reliable results.

SDR Console V3: New and indispensable Software

V3_Dimtsi

“Living Sonagram”: On the right window, you see a part of a 24 h recording at 6,1 MHz bandwidth (ca. 2 TB) with 1 line/second. Tagged is the sign on of Dimtsi Hafash which is received by the undocked “Receive” panel of V3’s GUI. At the bottom: signal strength on 7180 kHz over 24 hours reveals e.g. s/on, s/off and fade in.

Just a small note on a real real big event: Simon Brown, G4ELI, has published V3 of his indispensable SDR Console software on June 18th, 2018 – after three and a half years of heavy coding. Download it here and donate. Or vice versa.

V3 is a quite universal software for most SDRs on the market. For all, it provides the same graphical user interface (GUI) and the same functions (plus those specific to some devices).

All

DXer’s delight: On top the sonagram to visually catch signals (here: JDG from Diego Garcia; tagged). Bottom, from left to right: receive GUI for fine tuning, decoder W-Code showing “JDG”, below this “Playback” panel for controlling the recording (back/forward, e.g.), and on the right a database.

There are many unique functions and modules which will take DXing with SDRs to the next step. For now, let me mention just two of them:

  • 24 parallel demodulators within the SDR’s bandwidth – fully independent in e.g. mode, bandwidth and AGC to receive, record and decode 24 signals/channels in parallel.
  • a sophisticated File Analyser  which presents a recorded band as “living sonagram” – whre you see and click to a signal which then is played via the basic GUI

6pane

Up to six parallel demodulators can be seen on the main screen (from up to 24 possible).

 

1520

1520 kHz from 18:00 to 05:00 UTC (local SR/SS: 19:43/02:58 UTC) with 100 Hz bandwidth and 0,0031 Hz resolution (= +65 dB over 10 kHz!) reveals at least 27 stations and their offsets.

Each of these just two features mentioned will open new worlds for DXing and even serious professional monitoring. I will be happy to come back to some applications of V3 in more detail.

Thank you very much, Simon, for providing this excellent tool for free!

4800

4’800 kHz: First CNR1 with sign on at 20:15 UTC and fade out, then AIR Hyderabad with the same, but s/on around 00:06 UTC.

 

7435kHz

You may export levels over time on one frequency or level over frequencies at a given time. This graph visualizes the activity on 7435 kHz with 86’400 levels (on per second over 24 h). The data had been exported to QtiPlot for further investigation.

« Older Entries