spark 打包不合理

1. 查看 install 内容，spark 编译完成之后只是简单的将整个源码目录做了一份拷贝:

```bash
%install
mkdir -p %{buildroot}/opt/
cp -rf ../%{name}-%{version} %{buildroot}/opt/apache-%{name}-%{version}
```

这会引入很多不必要的文件，例如不必要的 class 文件和 java 文件：

```bash
[root@localhost apache-spark-3.0.1]# find -type f | grep -E "\.class$|\.java$" | wc -l
21126
```

2. 使用 checkSo 工具扫描 spark 的 aarch64 架构 rpm 包安装路径，得到如下结果：

```bash
[root@localhost checkSo]# cat JarResult.log 
commons-crypto-1.0.0.jar libcommons-crypto.so
leveldbjni-all-1.8.jar libleveldbjni.so
netty-all-4.1.47.Final.jar libnetty_transport_native_epoll_x86_64.so
scala-compiler-2.12.10.jar libjansi.so
```

可见部分 jni 对象中缺失 aarch64 架构可能所需的 shared object：

```bash
[root@localhost test]# fd -e so
META-INF/native/libnetty_transport_native_epoll_x86_64.so
[root@localhost test]# file META-INF/native/libnetty_transport_native_epoll_x86_64.so
META-INF/native/libnetty_transport_native_epoll_x86_64.so: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, BuildID[sha1]=63eac57b55dbff15b5066a2e9cd17fd9703fa0a8, not stripped
```

```bash
[root@localhost test]# fd -e so | xargs file
org/apache/commons/crypto/native/Linux/x86/libcommons-crypto.so:    ELF 32-bit LSB shared object, Intel 80386, version 1 (SYSV), dynamically linked, BuildID[sha1]=8ac1a98970ae0c7386c7402fbf24b0fb496459dc, stripped
org/apache/commons/crypto/native/Linux/x86_64/libcommons-crypto.so: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, BuildID[sha1]=1ce720871991d977d94529f840eae0cd8028f428, stripped
```

src-openEuler/spark

内容风险标识

评论 (1)

src-openEuler/spark .gitee-modal { width: 500px !important; }

内容风险标识