@@ -295,9 +295,7 @@ Change Streams
295
295
.. note::
296
296
297
297
If you use ``SparkConf`` to set the connector's change stream
298
- configurations, prefix ``spark.mongodb.change.stream.`` to each
299
-
300
- property.
298
+ configurations, prefix ``spark.mongodb.`` to each property.
301
299
302
300
.. list-table::
303
301
:header-rows: 1
@@ -318,14 +316,14 @@ Change Streams
318
316
original document and updated document as well as a copy of the
319
317
entire updated document.
320
318
319
+ **Default:** "default"
320
+
321
321
.. tip::
322
322
323
323
For more information on how this change stream option works,
324
324
see the MongoDB server manual guide
325
325
:manual:`Lookup Full Document for Update Operation </changeStreams/#lookup-full-document-for-update-operations>`.
326
326
327
- **Default:** "default"
328
-
329
327
* - ``change.stream.publish.full.document.only``
330
328
- | Specifies whether to publish the changed document or the full
331
329
change stream document.
@@ -338,14 +336,26 @@ Change Streams
338
336
- If you don't specify a schema, the connector infers the schema
339
337
from the change stream document rather than from the underlying collection.
340
338
339
+ **Default**: ``false``
340
+
341
341
.. note::
342
342
343
343
This setting overrides the ``change.stream.lookup.full.document``
344
344
setting.
345
345
346
+ * - ``change.stream.micro.batch.max.partition.count``
347
+ - | The maximum number of partitions the {+connector-short+} divides each
348
+ micro-batch into. Spark workers can process these partitions in parallel.
349
+ |
350
+ | This setting applies only when using micro-batch streams.
346
351
|
347
- | **Default**: ``false``
352
+ | **Default**: ``1``
353
+
354
+ .. warning:: Event Order
348
355
356
+ Specifying a value larger than ``1`` can alter the order in which
357
+ the {+connector-short+} processes change events. Avoid this setting
358
+ if out-of-order processing could create data inconsistencies downstream.
349
359
350
360
.. _configure-input-uri:
351
361
0 commit comments