python-bitflow is a python library for sending, receiving and transforming streams of data. Read the documentation under bitflow.rtfd.io to learn more about bitflow and the correlated projects.
Python-bitflow is current running in python3.7. It may run under other python3.x version but is not tested yet.
You can install python-bitflow by running the following command. This will put the exection script python-bitflow into your $PATH and will make the bitflow classes availble within your current python environmnet.
python setup.py install
Bitflow script is a powerfull scripting language. It allows to define pipelines, processing steps (order), forks and more.
Get help:
python-bitflow --help
Get an overview of all available processing steps and forks
python-bitflow -capabilities
python-bitflow -script "testing/testing_file_in.txt -> Noop()""
This will generate in .png file in the current path
python-bitflow -script "testing/in.csv-> PlotLinePlot(metric_names='ongoing_connections')"
Reads testing file, if tag "filter" is set to "port_1935" the metric pkg_out_1300-1400 will be plottet, else if tag "filter" is set to "port_1936" the metric pkg_out_1400-1500. Afterwards both kind of samples got forwarded to a Noop() processing step.
python-bitflow -script "testing/in.csv -> Fork_Tags(tag='filter'){ port_1935 -> PlotLinePlot(metric_names='pkg_out_1300-1400') ; port_1936 -> PlotLinePlot(metric_names='pkg_out_1400-1500') } -> Noop()"
python-bitflow -script "testing/in.csv -> my_processing()" -p my_processing.py
Current version does not close properly in all cases. Use strg-C to exit.
bitflow-example.py: provides a short overview about how to setup a pipeline and initialize source,sink, and processing steps.
download-data.py: downloads data from a given endpoint, filters samples
provide-data.py: reads a file and provides this file via a listen port
- closing python-bitflow properly
- Forks are currently not listed in -capabilities