Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions eng/versioning/version_client.txt
Original file line number Diff line number Diff line change
Expand Up @@ -106,11 +106,11 @@ com.azure:azure-cosmos;4.73.1;4.74.0
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3_2-12;1.0.0-beta.1;1.0.0-beta.1
com.azure:azure-cosmos-encryption;2.22.0;2.23.0
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.38.0;4.39.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.38.0;4.39.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.38.0;4.39.0-beta.1
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.38.0;4.39.0
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.38.0;4.39.0
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.38.0;4.39.0
com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample;1.0.0-beta.1;1.0.0-beta.1
com.azure.cosmos.spark:fabric-cosmos-spark-auth_3;1.0.0-beta.1;1.0.0-beta.2
com.azure.cosmos.spark:fabric-cosmos-spark-auth_3;1.0.0-beta.1;1.0.0
com.azure:azure-cosmos-test;1.0.0-beta.13;1.0.0-beta.14
com.azure:azure-cosmos-tests;1.0.0-beta.1;1.0.0-beta.1
com.azure:azure-data-appconfiguration;1.8.3;1.9.0-beta.1
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -97,7 +97,7 @@
<dependency>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-5_2-12</artifactId>
<version>4.39.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
<version>4.39.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
<scope>provided</scope>
</dependency>
<dependency>
Expand Down Expand Up @@ -292,7 +292,7 @@
<include>com.fasterxml.jackson.core:jackson-databind:[2.15.2]</include> <!-- {x-include-update;cosmos_com.fasterxml.jackson.core:jackson-databind;external_dependency} -->
<include>com.fasterxml.jackson.module:jackson-module-scala_2.12:[2.15.2]</include> <!-- {x-include-update;cosmos_com.fasterxml.jackson.module:jackson-module-scala_2.12;external_dependency} -->
<include>com.globalmentor:hadoop-bare-naked-local-fs:[0.1.0]</include> <!-- {x-include-update;cosmos_com.globalmentor:hadoop-bare-naked-local-fs;external_dependency} -->
<include>com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:[4.39.0-beta.1]</include> <!-- {x-include-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
<include>com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:[4.39.0]</include> <!-- {x-include-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
</includes>
</bannedDependencies>
</rules>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,18 +1,12 @@
## Release History

### 4.39.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.39.0 (2025-09-05)

#### Bugs Fixed
* Reverted known issue due to shading log4j (which was introduced in 4.38.1). - See [PR 46546](https://github.com/Azure/azure-sdk-for-java/pull/46546) and [PR 46608](https://github.com/Azure/azure-sdk-for-java/pull/46608)
* Added change feed performance monitoring which is used to improve end lsn calculation in `CosmosPartitionPlanner`. - See [PR 46320](https://github.com/Azure/azure-sdk-for-java/pull/46320)
* Added `spark.cosmos.auth.aad.audience` as a valid configuration option to allow using AAD tokens with custom audiences. - See [PR 46554](https://github.com/Azure/azure-sdk-for-java/pull/46554)

#### Other Changes

### 4.38.1 (2025-08-22)

**NOTE: This version has a known issue due to shading log4j - Please use more recent versions >= 4.38.2 or 4.38.0 instead**
Expand Down
7 changes: 5 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
| 4.39.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
Expand Down Expand Up @@ -73,6 +74,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
| 4.39.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
Expand Down Expand Up @@ -109,6 +111,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-5_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|----------------------|----------------------------|-------------------------------|
| 4.39.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
Expand All @@ -131,11 +134,11 @@ to use the same version of Scala that Spark was compiled for.
### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.38.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.39.0`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.38.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.39.0"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-3_2-12</artifactId>
<version>4.39.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
<version>4.39.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-3_2-12</url>
<name>OLTP Spark 3.3 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-4_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,18 +1,12 @@
## Release History

### 4.39.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.39.0 (2025-09-05)

#### Bugs Fixed
* Reverted known issue due to shading log4j (which was introduced in 4.38.1). - See [PR 46546](https://github.com/Azure/azure-sdk-for-java/pull/46546) and [PR 46608](https://github.com/Azure/azure-sdk-for-java/pull/46608)
* Added change feed performance monitoring which is used to improve end lsn calculation in `CosmosPartitionPlanner`. - See [PR 46320](https://github.com/Azure/azure-sdk-for-java/pull/46320)
* Added `spark.cosmos.auth.aad.audience` as a valid configuration option to allow using AAD tokens with custom audiences. - See [PR 46554](https://github.com/Azure/azure-sdk-for-java/pull/46554)

#### Other Changes

### 4.38.1 (2025-08-22)

**NOTE: This version has a known issue due to shading log4j - Please use more recent versions >= 4.38.2 or 4.38.0 instead**
Expand Down
7 changes: 5 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-4_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
| 4.39.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
Expand Down Expand Up @@ -64,6 +65,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
| 4.39.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
Expand Down Expand Up @@ -109,6 +111,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-5_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
| 4.39.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
Expand All @@ -131,11 +134,11 @@ to use the same version of Scala that Spark was compiled for.
### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.38.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.39.0`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.38.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.39.0"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-4_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-4_2-12</artifactId>
<version>4.39.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
<version>4.39.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-4_2-12</url>
<name>OLTP Spark 3.4 Connector for Azure Cosmos DB SQL API</name>
Expand Down
8 changes: 1 addition & 7 deletions sdk/cosmos/azure-cosmos-spark_3-5_2-12/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,18 +1,12 @@
## Release History

### 4.39.0-beta.1 (Unreleased)

#### Features Added

#### Breaking Changes
### 4.39.0 (2025-09-05)

#### Bugs Fixed
* Reverted known issue due to shading log4j (which was introduced in 4.38.1). - See [PR 46546](https://github.com/Azure/azure-sdk-for-java/pull/46546) and [PR 46608](https://github.com/Azure/azure-sdk-for-java/pull/46608)
* Added change feed performance monitoring which is used to improve end lsn calculation in `CosmosPartitionPlanner`. - See [PR 46320](https://github.com/Azure/azure-sdk-for-java/pull/46320)
* Added `spark.cosmos.auth.aad.audience` as a valid configuration option to allow using AAD tokens with custom audiences. - See [PR 46554](https://github.com/Azure/azure-sdk-for-java/pull/46554)

#### Other Changes

### 4.38.1 (2025-08-22)

**NOTE: This version has a known issue due to shading log4j - Please use more recent versions >= 4.38.2 or 4.38.0 instead**
Expand Down
7 changes: 5 additions & 2 deletions sdk/cosmos/azure-cosmos-spark_3-5_2-12/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
#### azure-cosmos-spark_3-5_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|-----------------------|---------------------------|-------------------------------|
| 4.39.0 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
Expand All @@ -50,6 +51,7 @@ to use the same version of Scala that Spark was compiled for.
#### azure-cosmos-spark_3-4_2-12
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
| 4.39.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
Expand Down Expand Up @@ -86,6 +88,7 @@ to use the same version of Scala that Spark was compiled for.
#### azure-cosmos-spark_3-3_2-12
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
| 4.39.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
Expand Down Expand Up @@ -131,11 +134,11 @@ to use the same version of Scala that Spark was compiled for.
### Download

You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 14 from Maven:
`com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.38.0`
`com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.39.0`

You can also integrate against Cosmos DB Spark Connector in your SBT project:
```scala
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-5_2-12" % "4.38.0"
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-5_2-12" % "4.39.0"
```

Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).
Expand Down
2 changes: 1 addition & 1 deletion sdk/cosmos/azure-cosmos-spark_3-5_2-12/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
</parent>
<groupId>com.azure.cosmos.spark</groupId>
<artifactId>azure-cosmos-spark_3-5_2-12</artifactId>
<version>4.39.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
<version>4.39.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
<packaging>jar</packaging>
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-5_2-12</url>
<name>OLTP Spark 3.5 Connector for Azure Cosmos DB SQL API</name>
Expand Down
6 changes: 3 additions & 3 deletions sdk/cosmos/azure-cosmos-spark_3_2-12/docs/quick-start.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,13 +25,13 @@ You can use any other Spark 3.5 spark offering as well, also you should be able
SLF4J is only needed if you plan to use logging, please also download an SLF4J binding which will link the SLF4J API with the logging implementation of your choice. See the [SLF4J user manual](https://www.slf4j.org/manual.html) for more information.

For Spark 3.3:
- Install Cosmos DB Spark Connector, in your spark Cluster [com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.37.2](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-3_2-12/4.37.2/jar)
- Install Cosmos DB Spark Connector, in your spark Cluster [com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.39.0](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-3_2-12/4.39.0/jar)

For Spark 3.4:
- Install Cosmos DB Spark Connector, in your spark Cluster [com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.37.2](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-4_2-12/4.37.2/jar)
- Install Cosmos DB Spark Connector, in your spark Cluster [com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.39.0](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-4_2-12/4.39.0/jar)

For Spark 3.5:
- Install Cosmos DB Spark Connector, in your spark Cluster [com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.37.2](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-5_2-12/4.37.2/jar)
- Install Cosmos DB Spark Connector, in your spark Cluster [com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.39.0](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-5_2-12/4.39.0/jar)


The getting started guide is based on PySpark however you can use the equivalent scala version as well, and you can run the following code snippet in an Azure Databricks PySpark notebook.
Expand Down
10 changes: 2 additions & 8 deletions sdk/cosmos/fabric-cosmos-spark-auth_3/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,8 @@
## Release History

### 1.0.0-beta.2 (Unreleased)

### 1.0.0 (2025-09-05)
#### Features Added

#### Breaking Changes

#### Bugs Fixed

#### Other Changes
* Released GA version 1.0.0 of `fabric-cosmos-spark-auth_3`.

### 1.0.0-beta.1 (2025-07-31)

Expand Down
Loading
Loading