Skip to content

Commit 02003da

Browse files
steverenschmalliso
authored andcommitted
DOCSP-12146: [KAFKA] Copy existing configuration with pipeline
1 parent a98d44c commit 02003da

File tree

1 file changed

+22
-0
lines changed

1 file changed

+22
-0
lines changed

source/kafka-source.txt

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -216,6 +216,28 @@ an example source connector configuration file, see
216216
| **Default**: 16000
217217
| **Accepted Values**: An integer
218218

219+
* - copy.existing.pipeline
220+
- list
221+
- | An array of JSON objects describing the :manual:`pipeline operations
222+
</core/aggregation-pipeline/>` to run when copying existing data.
223+
This can improve the use of indexes by the copying manager and
224+
make copying more efficient.
225+
226+
.. example::
227+
228+
In the following example, the :manual:`$match
229+
</reference/operator/aggregation/match/>` aggregation operator
230+
ensures that only documents in which the ``closed`` field is
231+
set to ``false`` are copied.
232+
233+
.. code-block:: none
234+
235+
copy.existing.pipeline=[ { "$match": { "closed": "false" } } ]
236+
237+
|
238+
| **Default**: ""
239+
| **Accepted Values**: Valid aggregation pipeline stages
240+
219241
* - errors.tolerance
220242
- string
221243
- | Whether to continue processing messages if an error is encountered.

0 commit comments

Comments
 (0)