You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fixing this issue would be nice since we could include the processors as part of conduit pipeline ls before we release 0.13.0
Working on #2019, I noticed that even though a pipeline contains a processor, the PipelineService doesn't include this information, appearing to be empty:
curl -X 'GET' \
'http://localhost:8080/v1/pipelines' \
-H 'accept: application/json'
[
{
"id": "add-department",
"state": {
"status": "STATUS_RUNNING",
"error": ""
},
"config": {
"name": "add-department",
"description": "An example pipeline which reads data (imaginary employees) from two generator sources, processes it and writes it to a file.\nIt attaches the built-in `field.set` processor to one of the sources to add a `department` field to its records. The records from the other source are not processed.\n"
},
"connectorIds": [
"add-department:employees-1",
"add-department:employees-2",
"add-department:file-destination"
],
"processorIds": [],
"createdAt": "2025-01-09T12:23:13.737117Z",
"updatedAt": "2025-01-09T12:23:13.737693Z"
}
]
Here's my yaml
version: 2.2pipelines:
- id: add-departmentstatus: runningdescription: > An example pipeline which reads data (imaginary employees) from two generator sources, processes it and writes it to a file. It attaches the built-in `field.set` processor to one of the sources to add a `department` field to its records. The records from the other source are not processed.connectors:
- id: employees-1type: sourceplugin: builtin:generatorsettings:
format.type: "structured"format.options.id: intformat.options.name: stringformat.options.company: stringformat.options.trial: boolrecordCount: "1"processors:
- id: extract-nameplugin: field.setsettings:
field: '.Payload.After.department'value: 'finance'
- id: employees-2type: sourceplugin: builtin:generatorsettings:
# department collectionformat.type: "structured"format.options.id: intformat.options.name: stringformat.options.company: stringformat.options.trial: boolrecordCount: "2"
- id: file-destinationtype: destinationplugin: builtin:filesettings:
path: ./example.out
Bug description
Important
Fixing this issue would be nice since we could include the processors as part of
conduit pipeline ls
before we release 0.13.0Working on #2019, I noticed that even though a pipeline contains a processor, the PipelineService doesn't include this information, appearing to be empty:
Here's my yaml
Steps to reproduce
Version
v0.13.0-nightly.20250110
The text was updated successfully, but these errors were encountered: