The concept of using a Destination Buffer in a flow is to store data retrieved from an HTTP Service temporarily. The stored data can then be used repeatedly in other flows to retrieve the data without having to revisit the HTTP Service.

A Buffer can be likened to physical storage, be it memory or disk, and temporarily hold data while moving between processes. Typically, the data is stored in a buffer as it is retrieved from a source (i.e., a database or another web service) before it is sent to another flow or device.

In Synatic, you can process Buffer data using a Buffer step to retrieve data from a source or use a Buffer step to submit the data to various other destinations or devices.


Using a Buffer Step

The Buffer Step is located in the Destination drawer in the Steps palette. To use a Buffer Step, select and drag it to the desired location in the flow, and use it to populate the Buffer from a JSON file.


Configuring the Buffer Step

The configuration for this step has two options plus two Advanced Mode options.

Buffer Id

The Buffer ID is the target Buffer that is used in the flow.

  • Click the + icon to create a new Buffer, or

  • Click Select a Buffer to select a pre-created Buffer from the selection list.


Operation

These operations, also known as data manipulation language (DML) operations, let you maintain rows of data in a Buffer.

The following operations are available:

  • Insert - Inserts a new record into the Buffer.

  • Upsert - Inserts a record if it does not already exist, but will update a record if it does exist.

  • Update - Updates an already existing record with changed data.

  • Delete - Performs a delete operation on the target Buffer and removes the selected record.

Let's take a closer look at the operations that you can select:

Insert

Select the Insert option from the Operation selection list.

There are no extra options to consider for the insert operation as records will be added to the buffer data one by one.


Upsert

Select the Upsert option from the Operation selection list.

The Upsert option has two options that you may use to update a specifically defined record/document.

  • Key Field - This field defines the record/document to be updated.

  • Value Field - This is the value field that will be updated.
    📝 If other values differ, then only the data in the Value field will be updated.
    📝 If you leave the Value field blank, it merges or updates the entire record/document.


Update

Select the Update option from the Operation selection list.

The Update option has four options that you may use to update multiple defined records/documents.

  • Filter - This option uses the Query builder to identify multiple key fields to update.

  • Value Field - This is the value field that will be updated.
    📝 If other values differ, then only the data in the Value field will be updated.
    📝 If you leave the Value field blank, it merges or updates the entire record/document.

  • Update One - Select this option to update only the first record encountered.

  • Upsert - Select this option to apply the Upsert method of updating records/documents.


Delete

Select the Delete option from the Operation selection list.

The Delete option has two options that you may use to update multiple defined records/documents.

  • Filter - This option uses the Query builder to identify multiple key fields to delete.

  • Delete One - Select this option to delete only the first record encountered.


Advanced Mode Options

The Advanced Mode offers two more options to select.

Purge before

Select this option to purge the Buffer before the Flow run starts.

Batch Size

Enter the number of records to hold before inserting them into the Buffer.


Limitations and known issues

None.


See Also

Read about other Destination Steps


Useful Tutorials

Revisit the Getting Started page for a refresher.

Read more about Steps here.

Read more about Buffers here.

Did this answer your question?