Skip to main content

Blocks


The blocks are available on the Toolbox tab .

image

Activate the panel by selecting the Toolbox option from the View main menu or the icon from the bottom bar.

image

Input blocks​

Input blocks allow loading and using data from files of various formats.

IconFunction
imageTrivial XML Input File: the option allows loading an XML format file. The function is available for files of the simple tree structure where one kind of a multiple element which corresponds with a tree root occurs under the root.
imageKVF Input File: the option allows loading data from the KVF format file of the key-value type.
imageFixed Length Input File: the option allows loading data from the Fixed length input file. The file format characterizes data which always has the same specified place in the structure and the same parameters (number of characters).
imageDatabase Reader: the function allows downloading records from databases using an SQL template. The SQL template has been equipped with the option of referring to query elements.
imageExcel Input File: the option allows reading data from files created by the Microsoft Excel spreadsheet (*.xls, *xlsx). Downloading data means dividing a file into flat data tables represented by the Excel table blocks which allow simple data processing.
imageRandom Data Generator: the option allows generating a defined number of random data records. The generated fields may be subject to additional conditions such as: range, regular expression, dictionary values, etc.
imageRegular Expression File: the function allows dividing input data and matching them by applying appropriate regular expressions in the record root.
imageCSV Input File: the option allows loading data from the CSV format file which is supported by most spreadsheets and database programs.
imageRecord Input File: allows reading records from a binary format. This file is very compact and fast. Block is used to read data stored by Record Output File block in a previous phase.
imageRead Files: allows retrieving information about and contents of files.
imageMongoDB Reader:enables reading data from MongoDB database.

Transformation blocks​

Transformation blocks allow data management and modification, business analysis, customization of file models for the systems which will eventually deal with querying and interpreting them.

IconFunction
imageMap Copy: the option allows creating a new data record on the basis of the original fragment of the analyzed record.
imageMap In Place: the option allows processing and modifying the analyzed data record without creating a copy.
imageSplit Way: the option allows proper classification and segregation of file records using expressions assigned to particular ports.
imageRun Code: the function of calling the indicated code on each input/output/passing record or query.
imageMerge Way: mergers processing paths, separeted earlier by classification operation.
imageMerge Join: the function allows joining sorted records which come from two record streams into one set.
imageNormalizer: the option allows changing a data structure from a redundant table to a branching tree.
imageLoop Join: the option allows joining the query results from an additional source to records from the original source.
imageSplit Tree: the option allows splitting records into parts, conditionally "cutting off" or cloning subtrees in the indicated place.
imageAggregation: allows aggregating all values in the same field of all processed records with a selected aggregation function.
imagePivot: allows filling a record with data by indicating fields containing path components and values to insert.
imageRun code - complex types: block for executing indicated code on every passing record or query.

Output blocks​

Output blocks are responsible for loading the appropriately processed data to output files.

The User may load data to a required format in the given reporting or analytical situation.

IconFunction
imageDatabase Writer: the function allows writing records to a database.
imageFixed Lenght Output File: the option that allows saving earlier-processed data to a Fixed length output file. The file format characterizes data that always has the same specified location in the structure and the same specified parameters (number of characters).
imageTyped XML Output File: the option allows saving processed data to an XML format file. The saved file is divided into a main part and lists of data represented by the list blocks.
imageTrivial XML Output File: the option allows for saving records to a file with an XML format as multiple elements directly under the root. Data fields values may become attributes or elements.
imageKVF Output File: the option allows saving flat input records to a file with the lines of the form "key=value" with an additional records separator.
imageRecord Output File: Allows writing data records in a binary file. This file is very compact and fast. Block is used for temporary storage for records to be used in subsequent phase of processing (eg. for shorting the data before processing).
imageCSV Output File: the option allows saving processed data to a file with CSV format that is supported by most of spreadsheets and database programs.
imageTemplated Output File: allows writing data to a file in a format defined with a template.
imageTrivial Excel Output File: allows writing records to a file in Excel format. Data record can have a tree structure.
imageSend e-mail: allows sending e-mails. You can select receivers, message text and append attachments.
imageTrash: disposing of unneeded records. Allows counting of records and queries.

Design tools blocks​

The blocks gathered in this section are the design blocks of the processing package.

IconFunction
imageLoad Dictionary: the option allows loading input records, using them to create an index and then querying them.
imageBrowse Data: the function lets through or stores the queries passing through and allows previewing collected data.
imageError Collector: the function allows gathering errors coming from all the blocks of the given phase.
imageData Profile: the option allows profiling data and extracting suitable information from it, such as data sorting, data kind and format, etc.
imageIndex K->V: the option allows indexing the passing-through records by the key selected by the User.
imageProcessing Report: a tool which generates a report of processing data from all the blocks of the given phase.
imageIndexOuterJoinReport: allows indexing of passing records by a user-selected key.
imageInline subpackage: inlines a subpackage in place of this block, ports are taken from Input port and Output port block in the subpackage.
imageInput port: block used in subpackages to represent input port, that is a place from which data will flow from containing package.
imageOutput port: block used in subpackages to represent output port, that is a place from which data will flow to the containing package and queries will flow in oposite direction.
imageInvokes a package: invokes another processing package in another engine by passing arguments and block's parameters. Retrieves a result.
imageRespond with query itself: responds to a query with a simple function of its content. Does not query any external data sources.
imageText annotation: allows you to add descriptions (comments) within the processing package you are creating.

General tools​

IconFunction
imageCall web-service: sends request to specified service through WCF and processes it's response.
imageRequest: waits for input requested and puts ii into further processing.
imageResponse: returns a query's response to caller.
imageWorkflow start: allows you to start the indicated workflow.
imageDocument generation: allows you to generate documents in DOCX and PDF formats based on a template.
imageExecute the algorithm: executes an algorithm element on a data structure. Places results in the same structure.
imageABBYY Flexicapture get data: used to build a service capable of responding to data export requests from ABBYY Flexicapture (plugin required).
imageABBYY Flexicapture processing end: used to build a service capable of responding to data export requests from ABBYY Flexicapture (plugin required).

See also​

Transformation blocks

Output blocks

Design tools