Differences

This shows you the differences between two versions of the page.

--- en:algorithms [2014/07/31 15:22] – fluktuacia
+++ en:algorithms [2019/04/11 17:17] (current) – [Existing iPython scripts] fluktuacia
@@ Line 1: / Line 1: @@
 ====== Methods of data processing used in Bolidozor network ======
-Bolidozor network attempts to process data of different quality and from various sources. However, most of the methods used for data processing is not yet sufficiently optimized.
+This site contains several designs of algorithms used for data processing.
+  * Estimate of an vector of meteor in the atmosphere
+  * Record of available meteorological data for future reconstructions (satellite images, ČHMÚ measurements at a particular time, radar images)
+  * Data collections from individual stations
+  * Calculations of vector and vertical wind profile
+There are some already existing projects that can used in the process of data processing.
+  * [[http://boinc.berkeley.edu/|BOINC]]
+  * [[http://gnuradio.org/redmine/projects/gnuradio/wiki|GNU Radio]]
+  * [[http://sourceforge.net/projects/cutesdr/|CuteSDR]]
 ===== Calculation of meteor trail parameters  =====
-There already exists a network dealing with similar problem called [[http://meteor.uwo.ca/research/radar/cmor_intro.html|CMOR]], which observes meteors using transmitter and several receiver stations. Such approach is however not suitable for Bolidozor network.
+There already exists a network dealing with similar problem called [[http://meteor.uwo.ca/research/radar/cmor_intro.html|CMOR]], which observes meteors using transmitter and several receiver stations. Such approach is, however, not really suitable for Bolidozor network.
-The actual calculation of meteor path will be carried out using several methods. One of them uses [[https://en.wikipedia.org/wiki/Multilateration|multilateration]], based on different time shifts of records from individual stations. It is necessary to obtain the time shifts by means of time correlation of the recorded data. This correlation can either be done on time domain or frequency domain. In both cases it essential to first separate the signal from noise.
+The most realistic solution seems to be a calculations using spatial coordinates of meteor’s head-echo. This approach has already been tested
+[[http://ea4eoz.blogspot.cz/2016/04/determining-radiant-of-meteor-using_10.html|Miguel A. Vallejo, EA4EOZ]]
-The next step involves measurement of doppler parameters of meteor head-echos, which depend on the path inclination and speed.
+==== Data from GRAVES radar ====
-Overall calculation of the meteor path will be realized in two steps:
+{{:graves:graves_hyperboloids.png?600|}}
-  - Calculation of meteor position in relation to individual stations
-  - Calculation of vector paths in absolute coordinates
-=== Data processing ===
+  |TR| ≈ 700 km
+km < b < 100 km
+  |TM| + |MR| = Rb
+  Rb(tM)´ = 0
-  * Estimate of meteor trajectory in the atmosphere
-  * Record of available meteorological data for later reconstruction (satellite pictures, values measured by hydrometeorological instututes, radar images, etc.)
-  * Data collecting from individual stations
-  * Wind vector and altitude profile calculation
-Already existing projects that could be possibly used in further data processing:
+=== Meteor detection ===
+Currently, meteors are detected by comparing the signal intensity in an area, where we expect the radio reflection, with the signal intensity in an area with frequency shift to the transmitted signal.
+==== VOR transmitters ====
+Aircraft navigation [[en:vor|VOR]] transmitters are one of the options, how to see the radio reflections.
+=== Signal model ===
+To calculate the energy balance, Jakub Kákona has created a [[http://nbviewer.ipython.org/github/kaklik/iPython-models/blob/master/VOR_beacons.ipynb|model of signal]].
+=== Collecting the data ===
+When processing data from VOR beacons, it is necessary to solve a problem of lower radiated power of transmitter. Lower transmitter power causes that the intensity of received signals is often below the noise level.
+  * Signal detection above the noise level by at least one station
+  * Sending a control network packet with a request for data containing the suspicious part from the nearest stations. [[http://www.ros.org/about-ros/|Possiblity of using ROS]].
+  * Correlation of detected signal with noise on other stations.
+  * As a result of the calculation, the corresponding signal should be found in noise on other stations.
+  * A detection will be confirmed if the meteor will be detected on several stations at the same time.
+  * Otherwise, the event will be evaluated as a false detection.
+In case of positive detection, model parameters to calculate the replica have to be extracted from the signal.
+Calculation of path will be carried out using several methods. First is the [[https://en.wikipedia.org/wiki/Multilateration|multilateration]] based on different records’ time shifts on individual stations. Time shifts have to be obtained by time correlations of recorded data. This correlation can be carried out either in signal time-space or using Fourier transformations. In both cases, it is first necessary to isolate the useful signal of meteor in the noise.
+Next step is a measurement of doppler parameters of meteor’s head-echo, which determines the inclination and speed of the path.
+Overall, the path calculation implementation will be carried out in two steps:
+  - Calculation of meteor position with respect to individual stations (can be done using the reflection from meteor trail).
+  - Calculation of path vector in absolute coordinates.
+==== Data from DVB-T ====
+DVB-T signal has an advantage compared to VOR beacons in that it is broadband. This feature can help to improve the accuracy of measurement. However, the system transmits in multiplexes, meaning that there is a transmission of an identical signal from several places at once - causing a complication.
+=== Decesion process and search for fragments ===
+Should a scripting language be used to describe the [[http://www.ros.org/wiki/|ROS]] process?
+  * Command assignment to individual stations.
+  * Start re-planing due to unsuccessful launch or rejection from station.
+  * Control of a potential violation of airspace and prohibited zones.
+==== Multichannel detector from GnuRadio ====
+A Marcus Leech group, Science Radio Laboratories has prepared a signal schema for GnuRadio that enables a [[http://www.sbrac.org/files/meteor_forward_scatter.pdf|processing of more channels at once]].
+===== Optimising algorithms =====
+  * [[https://en.wikipedia.org/wiki/Particle_swarm_optimization|Particle swarm]]
+  * https://pypi.python.org/pypi/cma
+====== Tools for algorithms testing ======
+===== Interactive scientific tool Jupyter =====
+A good solution for testing is an interactive iPython environment where you can directly try individual parts of code and process data.
+Its basic installation in Ubuntu can be carried out by installing the following packages:
+  sudo apt-get install ipython-notebook python-scipy python-numpy
+Afterwards, you can run iPython from the command line:
+  ipython notebook --pylab inline
+In order to get acquainted with [[http://www.tutorialspoint.com/python/|Python]] language you can use [[https://www.codecademy.com/learn/python|Codeacademy]].
+==== Existing iPython scripts ====
+There are several already existing iPython notebooks for data processing from Bolidozor network - you can find them at:
+http://meteor1.astrozor.cz:8080/
+More specifically for example [[http://meteor1.astrozor.cz:8080/ntbk/pub/radio-processing/iPython/iDHProcessor.html|Histogram of frequency shift of meteors]] and [[http://meteor1.astrozor.cz:8080/ntbk/pub/trails-processing/interactive_meteors.html|Visualisation of meteor trails]] from [[cs:meteor-observer|Meteor Observer Mobile aplication]].
-  * [[http://boinc.berkeley.edu/|BOINC]]
-  * [[http://gnuradio.org/redmine/projects/gnuradio/wiki|GNU Radio]]
-  * [[http://sourceforge.net/projects/cutesdr/|CuteSDR]]
+Scripts on server are reloaded every 5 minutes with [[https://github.com/paulgb/runipy|runipy]] programme.