Extractors and Transformers

Overview

Extractors and Transformers are essential components within Dynamiq's platform that handle data transformation and extraction within your workflows. These nodes help you convert data between different formats, extract specific information using patterns, and retrieve targeted data elements to optimize your data processing tasks.

Data extraction and transformation nodes

Available Extractor and Transformer nodes

All nodes require minimal configuration after being added to the workflow.

TextTemplate Node

The Text Template Node processes the provided text template containing placeholders and dynamically replaces them with the corresponding input parameters. By mapping variables to predefined placeholders, this node ensures flexible and automated text generation for various use cases, such as personalized messages, dynamic content generation, and structured data formatting.

Workflow with TextTemplate node

Configuration

• Name: Customizable name for identifying this node.

• Template: Text structure with placeholders (e.g., { {variable_name}}) that will be dynamically replaced with input values.

Input

Input parameters are generated based on the placeholders in the provided template. For example, specifying the template below in the configuration will automatically create an input field for the 'user' variable:

Output

• Content: The final text with all placeholders replaced by the corresponding input values.

Usage Example

Workflow with specified template

Input:

{
    "name":"John",
    "order_id":"3703804"
}

Output:

{
    "content":"Hello, John! Your order with ID 3703804 has been shipped."
}

Any to JSON

The Any to JSON node converts objects (e.g., lists, dictionaries, etc.) into JSON format as a string, enabling standardized data serialization for storage, transmission, or further processing.

Workflow with Any to JSON node

Configuration

• Name: Customizable name for identifying this node.

Input

• Value: The object (e.g., list, dictionary, or other data structure) that you want to convert to JSON format.

Output

• Content: The JSON string representation of the input object, formatted as a standard JSON structure.

Usage Example

Input:

{
  "value": {
    "name": "John Doe",
    "age": 30,
    "city": "New York"
  }
}

{
  "value": [1,2,3]
}

Output:

{
    "content":"{'name': 'John Doe', 'age': 30, 'city': 'New York'}"
}

{
    "content": "[1, 2, 3]"
}

JSON to Any

The JSON to Any node performs the exact opposite operation of Any to JSON, converting JSON strings back into their original object types (e.g., lists, dictionaries, etc.) for native data manipulation.

Workflow with JSON to Any node

Configuration

• Name: Customizable name for identifying this node.

Input

• Value: The JSON string that you want to convert back to its original object format.

Output

• Content: The parsed object (list, dictionary, or other data structure) converted from the JSON string input.

Usage Example

Input:

{
  "value": "{"name": "John Doe", "age": 30, "city": "New York"}"
}

{
  "value": "[1, 2, 3]"
}

Output:

{
    "content":{
        "name":"John Doe",
        "age":30,
        "city":"New York"
    }
}

{
    "content": [1, 2, 3]
}

By Regex Extractor

The By Regex Extractor node extracts data that matches specific patterns from text using regular expressions, returning a list of all matches found. This node is particularly useful for parsing structured text and extracting specific information based on defined patterns.

Workflow with By Regex Extractor node

Configuration

• Name: Customizable name for identifying this node.

• Pattern: The regular expression pattern used to match and extract data from the input text. This parameter can be overridden by providing a pattern in the input parameters.

Input

• Value: The text string from which you want to extract data using the specified pattern.

• Pattern (optional): The regular expression pattern used to match and extract data from the input text. If provided, this will override the pattern specified in the configuration.

Output

• Matches: A list of all matches found in the input text that correspond to the regular expression pattern.

Usage Example

Workflow with specified pattern

Input:

{
  "value": "My phone is 123-456-7890 and John`s is 235-552-6393"
}

Output:

{
    "matches": ["123-456-7890","235-552-6393"]
}

By Index Extractor

The By Index Extractor node extracts specific elements from lists using their index position, allowing precise retrieval of data at known locations within ordered collections.

Workflow with By Index Extractor node

Configuration

• Name: Customizable name for identifying this node.

• Index: The position index of the element to extract from the input list. This parameter can be overridden by providing an index in the input parameters.

Input

• Input: The list from which you want to extract an element at the specified index position.

• Index (optional): The position index of the element to extract from the input list. If provided, this will override the index specified in the configuration.

Output

• Output: The element extracted from the input list at the specified index position.

Usage Example

Input:

{
  "input": [1, 2, 3, 4, 5],
  "index": 2
}

Output:

{
    "output": 3
}

File Type Extractor

The File Type Extractor node determines and extracts the type classification of files, identifying whether they are audio, video, font, presentation, or other file categories based on file metadata or passed file name.

Workflow with File Type Extractor node

Configuration

• Name: Customizable name for identifying this node.

Input

• File: The file object from which you want to determine the type classification.

• Filename: The filename string used to identify the file type based on extension and metadata.

Output

• Type: The classification of the file (e.g., audio, video, font, presentation, or other file categories) based on the file metadata or filename analysis.