Skip to content

Commit

Permalink
[SPARK-51193][CORE] Upgrade Netty to 4.1.118.Final and netty-tcnative…
Browse files Browse the repository at this point in the history 
… to 2.0.70.Final

### What changes were proposed in this pull request?

This PR aims to upgrade the following for Apache Spark 4.0.0.
- netty to 4.1.118.Final
- netty-tcnative to 2.0.70.Final

### Why are the changes needed?

To bring the latest bug fixes
- https://netty.io/news/2025/02/10/4-1-118-Final.html
    - https://github.com/netty/netty/releases/tag/netty-4.1.118.Final
        - netty/netty#14790
        - SslHandler doesn't correctly validate packets which can lead to native crash when using native SSLEngine
        - Denial of Service attack on windows app using Netty, again

### Does this PR introduce _any_ user-facing change?

No behavior change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#49923 from dongjoon-hyun/SPARK-51193.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
  • Loading branch information
@dongjoon-hyun
dongjoon-hyun committed Feb 13, 2025
1 parent 8e39b7f commit 0a10232
Show file tree
Hide file tree
Showing 2 changed files with 29 additions and 29 deletions.
54 changes: 27 additions & 27 deletions dev/deps/spark-deps-hadoop-3-hive-2.3
View file
Original file line number Diff line number Diff line change
Expand Up @@ -200,33 +200,33 @@ metrics-jmx/4.2.30//metrics-jmx-4.2.30.jar
metrics-json/4.2.30//metrics-json-4.2.30.jar
metrics-jvm/4.2.30//metrics-jvm-4.2.30.jar
minlog/1.3.0//minlog-1.3.0.jar
netty-all/4.1.117.Final//netty-all-4.1.117.Final.jar
netty-buffer/4.1.117.Final//netty-buffer-4.1.117.Final.jar
netty-codec-dns/4.1.117.Final//netty-codec-dns-4.1.117.Final.jar
netty-codec-http/4.1.117.Final//netty-codec-http-4.1.117.Final.jar
netty-codec-http2/4.1.117.Final//netty-codec-http2-4.1.117.Final.jar
netty-codec-socks/4.1.117.Final//netty-codec-socks-4.1.117.Final.jar
netty-codec/4.1.117.Final//netty-codec-4.1.117.Final.jar
netty-common/4.1.117.Final//netty-common-4.1.117.Final.jar
netty-handler-proxy/4.1.117.Final//netty-handler-proxy-4.1.117.Final.jar
netty-handler/4.1.117.Final//netty-handler-4.1.117.Final.jar
netty-resolver-dns/4.1.117.Final//netty-resolver-dns-4.1.117.Final.jar
netty-resolver/4.1.117.Final//netty-resolver-4.1.117.Final.jar
netty-tcnative-boringssl-static/2.0.69.Final/linux-aarch_64/netty-tcnative-boringssl-static-2.0.69.Final-linux-aarch_64.jar
netty-tcnative-boringssl-static/2.0.69.Final/linux-x86_64/netty-tcnative-boringssl-static-2.0.69.Final-linux-x86_64.jar
netty-tcnative-boringssl-static/2.0.69.Final/osx-aarch_64/netty-tcnative-boringssl-static-2.0.69.Final-osx-aarch_64.jar
netty-tcnative-boringssl-static/2.0.69.Final/osx-x86_64/netty-tcnative-boringssl-static-2.0.69.Final-osx-x86_64.jar
netty-tcnative-boringssl-static/2.0.69.Final/windows-x86_64/netty-tcnative-boringssl-static-2.0.69.Final-windows-x86_64.jar
netty-tcnative-classes/2.0.69.Final//netty-tcnative-classes-2.0.69.Final.jar
netty-transport-classes-epoll/4.1.117.Final//netty-transport-classes-epoll-4.1.117.Final.jar
netty-transport-classes-kqueue/4.1.117.Final//netty-transport-classes-kqueue-4.1.117.Final.jar
netty-transport-native-epoll/4.1.117.Final/linux-aarch_64/netty-transport-native-epoll-4.1.117.Final-linux-aarch_64.jar
netty-transport-native-epoll/4.1.117.Final/linux-riscv64/netty-transport-native-epoll-4.1.117.Final-linux-riscv64.jar
netty-transport-native-epoll/4.1.117.Final/linux-x86_64/netty-transport-native-epoll-4.1.117.Final-linux-x86_64.jar
netty-transport-native-kqueue/4.1.117.Final/osx-aarch_64/netty-transport-native-kqueue-4.1.117.Final-osx-aarch_64.jar
netty-transport-native-kqueue/4.1.117.Final/osx-x86_64/netty-transport-native-kqueue-4.1.117.Final-osx-x86_64.jar
netty-transport-native-unix-common/4.1.117.Final//netty-transport-native-unix-common-4.1.117.Final.jar
netty-transport/4.1.117.Final//netty-transport-4.1.117.Final.jar
netty-all/4.1.118.Final//netty-all-4.1.118.Final.jar
netty-buffer/4.1.118.Final//netty-buffer-4.1.118.Final.jar
netty-codec-dns/4.1.118.Final//netty-codec-dns-4.1.118.Final.jar
netty-codec-http/4.1.118.Final//netty-codec-http-4.1.118.Final.jar
netty-codec-http2/4.1.118.Final//netty-codec-http2-4.1.118.Final.jar
netty-codec-socks/4.1.118.Final//netty-codec-socks-4.1.118.Final.jar
netty-codec/4.1.118.Final//netty-codec-4.1.118.Final.jar
netty-common/4.1.118.Final//netty-common-4.1.118.Final.jar
netty-handler-proxy/4.1.118.Final//netty-handler-proxy-4.1.118.Final.jar
netty-handler/4.1.118.Final//netty-handler-4.1.118.Final.jar
netty-resolver-dns/4.1.118.Final//netty-resolver-dns-4.1.118.Final.jar
netty-resolver/4.1.118.Final//netty-resolver-4.1.118.Final.jar
netty-tcnative-boringssl-static/2.0.70.Final/linux-aarch_64/netty-tcnative-boringssl-static-2.0.70.Final-linux-aarch_64.jar
netty-tcnative-boringssl-static/2.0.70.Final/linux-x86_64/netty-tcnative-boringssl-static-2.0.70.Final-linux-x86_64.jar
netty-tcnative-boringssl-static/2.0.70.Final/osx-aarch_64/netty-tcnative-boringssl-static-2.0.70.Final-osx-aarch_64.jar
netty-tcnative-boringssl-static/2.0.70.Final/osx-x86_64/netty-tcnative-boringssl-static-2.0.70.Final-osx-x86_64.jar
netty-tcnative-boringssl-static/2.0.70.Final/windows-x86_64/netty-tcnative-boringssl-static-2.0.70.Final-windows-x86_64.jar
netty-tcnative-classes/2.0.70.Final//netty-tcnative-classes-2.0.70.Final.jar
netty-transport-classes-epoll/4.1.118.Final//netty-transport-classes-epoll-4.1.118.Final.jar
netty-transport-classes-kqueue/4.1.118.Final//netty-transport-classes-kqueue-4.1.118.Final.jar
netty-transport-native-epoll/4.1.118.Final/linux-aarch_64/netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
netty-transport-native-epoll/4.1.118.Final/linux-riscv64/netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
netty-transport-native-epoll/4.1.118.Final/linux-x86_64/netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
netty-transport-native-kqueue/4.1.118.Final/osx-aarch_64/netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
netty-transport-native-kqueue/4.1.118.Final/osx-x86_64/netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
netty-transport-native-unix-common/4.1.118.Final//netty-transport-native-unix-common-4.1.118.Final.jar
netty-transport/4.1.118.Final//netty-transport-4.1.118.Final.jar
objenesis/3.3//objenesis-3.3.jar
okhttp/3.12.12//okhttp-3.12.12.jar
okio/1.17.6//okio-1.17.6.jar
Expand Down
4 changes: 2 additions & 2 deletions pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -214,8 +214,8 @@
<bouncycastle.version>1.80</bouncycastle.version>
<tink.version>1.16.0</tink.version>
<datasketches.version>6.1.1</datasketches.version>
<netty.version>4.1.117.Final</netty.version>
<netty-tcnative.version>2.0.69.Final</netty-tcnative.version>
<netty.version>4.1.118.Final</netty.version>
<netty-tcnative.version>2.0.70.Final</netty-tcnative.version>
<icu4j.version>76.1</icu4j.version>
<junit-jupiter.version>5.11.4</junit-jupiter.version>
<junit-platform.version>1.11.4</junit-platform.version>
Expand Down

0 comments on commit 0a10232

Please sign in to comment.