Available translations

Data Mining - Managing Execution

foundations.png
Summary: Bots can execute at their own pace or they can wait for other bots to finish executing before starting.
Bot Execution Tree
A helpful way to think about managing bot execution is to think of the image of a tree. The roots support the trunk which supports the branches. In the same way, Superalgos uses many bots to process data each relying on the output of the last to form a tree. As data is passed through the tree the raw data is processed and reprocessed to build more and more elaborate datasets.
Types of Execution Managment
There are two types of execution managment:
  • Standalone Bots: These bots are the root of the Bot Execution Tree. They don't depend on any other bot to run but use the configuration of it's Process Definition node to run on a pre-defined schedule (in most cases every one minute).
  • Execution Dependent Bots: These bots are the branches of the Bot Execution Tree. They need to wait for other Bots to finish their execution in order to start.
Configuring a Standalone Bot
This is an example of how to configure a bot to execute as a Standalone Bot. Within the Process Definition of a Bot, the normalWaitTime property has a non zero value, in this case 60 seconds. 
 {
    "codeName": "Historic-OHLCVs",
    "description": "Retrieves and saves historical market data",
    "deadWaitTime": 0,
    "normalWaitTime": 60000,
    "retryWaitTime": 10000,
    "botModule": "Exchange Raw Data Historic OHLCVs"
}
Configuring an Execution Dependent Bot
In order to configure a bot to execute as an Execution Dependent Bot two things need to be in place.
  • Second, the Bot's Process Definition will need a zero in the normalWaitTime property. This will force the Bot to immediately run the next loop, but since there is an Execution Started Event defined, that will make it wait until the referenced Bot finishes. 
 {
    "codeName": "Multi-Time-Frame-Market",
    "normalWaitTime": 0,
    "retryWaitTime": 10000,
    "framework": {
        "name": "Multi-Time-Frame-Market"
    }
}
Previous
Data Mining - Data Mine Hierarchy
Next
Data Mining - Data Dependencies

Data Mining — TOC

You just read page 7 in the topic.

1. Data Mining - Introduction

2. Data Mining - Workflows

3. Data Mining - Dataset Types

4. Data Mining - Datasets Type Conversions

5. Data Mining - Indicator Frameworks

6. Data Mining - Data Mine Hierarchy

7. Data Mining - Managing Execution

8. Data Mining - Data Dependencies

9. Data Mining - Status Reports

10. Data Mining - Status Dependencies

11. Data Mining - Deployments

12. Data Mining - Products

13. Data Mining - Plotting

14. Data Mining - Fetching Data From APIs

15. Data Mining - Consuming Data From Strategies

16. Data Mining - Indicator Bots

17. Data Mining - Indicator Bots - Process Definition

18. Data Mining - Indicator Bots - Product Definition

19. Data Mining - Indicator Bots - Data Mining Workflow

20. Data Mining - Indicator Bots - Coding the Indicator's Logic

21. Data Mining - Plotters

22. Data Mining - Plotters - Shapes

23. Data Mining - How to Build an Indicator - Video Series