On this Page

MetricsHub
MetricsHub Community Connectors 1.0.22

    Home
  • Connector Developer Guide

Computes

Compute Pipeline Model

Computes run in order and transform source tables before mapping.

Most compute operations are column-oriented because they operate on table rows:

computes:
- type: replace
  column: 3
  existingValue: 1
  newValue: ok

Table example:

id display_name status_code
fan01 Fan A 1
fan02 Fan B 3

Serialized:

fan01;Fan A;1
fan02;Fan B;3

After translation/replace, mapping consumes the transformed table.

Note

Because serialization uses semicolons as column separators, some transforms that append semicolon-delimited content may increase the number of materialized columns after reparsing.

Compute Pages

Arithmetic and Bitwise

Compute Purpose
add[1] Add a value (literal or $n) to a numeric column.
subtract[2] Subtract a value from a numeric column.
multiply[3] Multiply a numeric column (unit conversions, sign flips).
divide[4] Divide a numeric column (unit conversions, ratios).
and[5] Bitwise AND a column with a bitmask.

String Manipulation

Compute Purpose
append[6] Concatenate a value to the end of a column (can materialize new columns with ;).
prepend[7] Concatenate a value to the start of a column (can materialize new columns with ;).
replace[8] Replace a literal value in a column.
substring[9] Keep a portion of a column's value (1-based start, length).
duplicateColumn[10] Insert a copy of a column immediately after the original.

Row Filtering and Column Projection

Compute Purpose
keepOnlyMatchingLines[11] Keep rows whose column matches a regex or value list.
excludeMatchingLines[12] Remove rows whose column matches a regex or value list.
keepColumns[13] Keep only the listed columns.
extract[14] Split a column on separators and keep one sub-part.
extractPropertyFromWbemPath[15] Pull one property value out of a WBEM object path.

Translation and Normalization

Compute Purpose
translate[16] Map raw values to normalized values through a translation table.
arrayTranslate[17] Translate each element of a multi-value cell.
perBitTranslation[18] Decode a bitmask status word bit by bit through a translation table.
convert[19] Built-in conversions: hex2Dec, array2SimpleStatus.

Format Conversion and Encoding

Compute Purpose
json2Csv[20] Flatten a JSON payload into table rows (prepends an entry column).
xml2Csv[21] Flatten an XML payload into table rows.
encode[22] Encode a column as base64 or url.
decode[23] Decode a base64 or url column.

Scripted Transformation

Compute Purpose
awk[24] Run an AWK script over the source result for arbitrary reshaping.
computes transformations metricshub community connector hardware system
Links:
  • [1] ./add.html
  • [2] ./subtract.html
  • [3] ./multiply.html
  • [4] ./divide.html
  • [5] ./and.html
  • [6] ./append.html
  • [7] ./prepend.html
  • [8] ./replace.html
  • [9] ./substring.html
  • [10] ./duplicate-column.html
  • [11] ./keep-only-matching-lines.html
  • [12] ./exclude-matching-lines.html
  • [13] ./keep-columns.html
  • [14] ./extract.html
  • [15] ./extract-wbem-property.html
  • [16] ./translate.html
  • [17] ./array-translate.html
  • [18] ./translate-per-bit.html
  • [19] ./convert.html
  • [20] ./json2csv.html
  • [21] ./xml2csv.html
  • [22] ./encode.html
  • [23] ./decode.html
  • [24] ./awk.html
Searching...
No results.