Available translations

Data Mining - Managing Execution

foundations.png
Summary: Bots can execute at their own pace or they can wait for other bots to finish executing before starting.
Bot Execution Tree
A helpful way to think about managing bot execution is to think of the image of a tree. The roots support the trunk which supports the branches. In the same way, Superalgos uses many bots to process data each relying on the output of the last to form a tree. As data is passed through the tree the raw data is processed and reprocessed to build more and more elaborate datasets.
Types of Execution Managment
There are two types of execution managment:
  • Standalone Bots: These bots are the root of the Bot Execution Tree. They don't depend on any other bot to run but use the configuration of it's Process Definition node to run on a pre-defined schedule (in most cases every one minute).
  • Execution Dependent Bots: These bots are the branches of the Bot Execution Tree. They need to wait for other Bots to finish their execution in order to start.
Configuring a Standalone Bot
This is an example of how to configure a bot to execute as a Standalone Bot. Within the Process Definition of a Bot, the normalWaitTime property has a non zero value, in this case 60 seconds.
 {
    "codeName": "Historic-OHLCVs",
    "description": "Retrieves and saves historical market data",
    "deadWaitTime": 0,
    "normalWaitTime": 60000,
    "retryWaitTime": 10000,
    "botModule": "Exchange Raw Data Historic OHLCVs"
}
Configuring an Execution Dependent Bot
In order to configure a bot to execute as an Execution Dependent Bot two things need to be in place.
  • Second, the Bot's Process Definition will need a zero in the normalWaitTime property. This will force the Bot to immediately run the next loop, but since there is an Execution Started Event defined, that will make it wait until the referenced Bot finishes.
 {
    "codeName": "Multi-Time-Frame-Market",
    "normalWaitTime": 0,
    "retryWaitTime": 10000,
    "framework": {
        "name": "Multi-Time-Frame-Market"
    }
}
Previous
Data Mining - Data Mine Hierarchy
Next
Data Mining - Data Dependencies