Workers

Workers are specialized execution components that function as web services called by beVault's States orchestrator. Each Worker is designed to accomplish a specific, well-defined type of task in your data workflows.

Workers operate on a polling model: they continuously query the States orchestrator to check if there are tasks to execute. When a task is assigned to them (via a state machine), the Worker executes it with the provided parameters and then returns the result to States. Workers can be deployed alongside other beVault components or directly on the client's infrastructure, avoiding the need to expose sensitive databases or systems to the Internet.

To access data, Workers use configured Stores (dbStores for databases, fileStores for file systems). Each Worker references a Store by its name to connect to the target system and perform the requested operation (read, write, transform, etc.).

This page lists all available Workers, identified by their Activity name, along with the minimum beVault version where they are available and a brief description of their function. Workers cover a wide range of operations: exporting SQL data to CSV or JSON, bulk loading into tables, file compression/decompression, HTTP calls, file management (list, move, delete), state machine execution, BI tool refresh (Tableau, Toucan Toco), geographic address enrichment, and much more.


If you need to create your own custom workers for specific needs, check out the following How-to guide: How to create your own custom workers?