Skip to main content

Add shaper

Shapers are nodes usually uniquely connected as head nodes, meaning that they receive data inputs but will output no data to another node. Developers can define the structure of output data when creating the source node.

We will connect it to our transformation afterwards.

To create a new shaper to our project we may use the sub-command holium shaper create:

$ holium shaper create sales_results --json-schema '        {            "type": "array",            "prefixItems": [{                "type": "array",                "items": {                    "type": "array",                    "prefixItems": [{                        "type": "string"                    }, {                        "type": "number"                    }]                }            }]        }        'new object created: sales_results

Once it is done we are able to list all of our shapers with the sub-command holium shaper list:

$ holium shaper listโ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ NAME          โ”‚ JSON Schema                  โ”‚โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”คโ”‚ sales_results โ”‚ {                            โ”‚โ”‚               โ”‚   "type": "array",           โ”‚โ”‚               โ”‚   "prefixItems": [           โ”‚โ”‚               โ”‚     {                        โ”‚โ”‚               โ”‚       "type": "array",       โ”‚โ”‚               โ”‚       "items": {             โ”‚โ”‚               โ”‚         "type": "array",     โ”‚โ”‚               โ”‚         "prefixItems": [     โ”‚โ”‚               โ”‚           {                  โ”‚โ”‚               โ”‚             "type": "string" โ”‚โ”‚               โ”‚           },                 โ”‚โ”‚               โ”‚           {                  โ”‚โ”‚               โ”‚             "type": "number" โ”‚โ”‚               โ”‚           }                  โ”‚โ”‚               โ”‚         ]                    โ”‚โ”‚               โ”‚    ...                       โ”‚โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

With this last object created, we have all objects necessary for us to build our pipeline. To finalize the pipeline build the final step is to connect all previously elements together.