在知乎上学习 bigdata
Iceberg + Spark + Trino + Dagster：现代的开源数据堆栈安装 | by ZD
注意需要修改 docker-compose 的文件，在 metas 服务下把 metabse.base.mv.db 修改为 metabse.db。
minio 采用的是这个 minio
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
|
minio:
hostname: minio
image: 'minio/minio'
container_name: minio
ports:
- '9000:9000'
- '9001:9001'
volumes:
- ./data/minio:/data
environment:
- MINIO_ROOT_USER=minio
- MINIO_ROOT_PASSWORD=minio123
command: server /data --console-address ":9001"
networks:
- ndsnet
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
interval: 5s
timeout: 5s
retries: 5
mc:
image: minio/mc
container_name: mc
hostname: mc
environment:
- AWS_ACCESS_KEY_ID=minio
- AWS_SECRET_ACCESS_KEY=minio123
- AWS_REGION=us-east-1
networks:
- ndsnet
entrypoint: >
/bin/sh -c "
until (/usr/bin/mc config host add minio http://minio:9000 minio minio123) do echo '...waiting...' && sleep 1; done;
/usr/bin/mc mb minio/warehouse;
/usr/bin/mc policy set public minio/warehouse;
exit 0;
"
depends_on:
minio:
condition: service_healthy
|
这个 minio 提供给 presto 可以使用，成功执行了，插入数据。
参考文档：
https://blog.csdn.net/weixin_39636364/article/details/122014932?spm=1001.2014.3001.5502