Commit Graph

1363 Commits

Author SHA1 Message Date
Mitsuru Kariya
02d042a6b9
Reduce image size
Do following actions to reduce the size of the generated images.

- Change `COPY` command + `chown`/`chmod` command to `COPY` command +
  `--chown`/`--chmod` option.
  To prevent both files before/after `chown`/`chmod` commands from being
  recorded on different layers.
- Put all `tdnf` commands in a single `RUN` command and move `tdnf clean all`
  command to the end.
  To prevent the `tdnf` cache from being recorded on a layer, and the `tdnf`
  database from being recorded on multiple layers.
- Add `--link` option to `COPY` command.
  This does not contribute to image size reduction, but makes image building
  more efficient.
- Move `chown /etc/pki/tls/certs` to the `Dockerfile.base`.
  This does not contribute to image size reduction, but is used in
  conjunction with `COPY --link` to make image building more efficient.

The target images and their sizes are as follows. (The sizes are the value
when built locally)

- harbor-core : 185MB -> 118MB
- harbor-db : 285MB -> 263MB
- harbor-exporter : 108MB -> 79.1MB
- harbor-jobservice : 159MB -> 105MB
- harbor-registryctl : 160MB -> 104MB
- redis-photon : 179MB -> 170 MB
- standalone-db-migrator : 328MB -> 284MB

Note that harbor-log, harbor-portal, and nginx-photon have almost no effect,
and prepare is not directly executed by the user, so they are not included.

Also, registry-photon and trivy-adapter-photon are not included, since
PR#20622 and PR#20623 include equivalent action for these two, respectively.

Signed-off-by: Mitsuru Kariya <mitsuru.kariya@nttdata.com>
2024-06-21 02:08:34 +09:00
stonezdj(Daojun Zhang)
1f0c8289a5
Add sbom_report table to store sbom related information (#20473)
fixes #20445
  Refactor scan/base_controller.go
  Move MakeReportPlaceholder, GetReportPlaceholder, GetSummary to vul and sbom scanHandler

Signed-off-by: stonezdj <stone.zhang@broadcom.com>
2024-05-24 08:48:55 +00:00
MinerYang
2da4d5883f
bump golang 1.22.3 (#20433)
* bump golang 1.22.3

Signed-off-by: yminer <yminer@vmware.com>

* debug api_common_install.sh

Signed-off-by: yminer <yminer@vmware.com>

* remove set DNS for docker v20

Signed-off-by: yminer <yminer@vmware.com>

---------

Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2024-05-16 14:32:59 +08:00
MinerYang
ea3cd06171
add prepare migration script for 2.11.0 (#20315)
Signed-off-by: yminer <yminer@vmware.com>

correct jaeger agent_host

update ip_family part
2024-04-22 16:34:08 +08:00
MinerYang
7e8032b144
bump golang to 1.22.2 (#20256)
Signed-off-by: yminer <yminer@vmware.com>

replace go get to go install

update go.mod
2024-04-12 13:46:29 +08:00
Shengwen YU
643e84cdfe
feat: expose trivy.timeout to configure the duration to wait for scan completion (#20257)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2024-04-11 10:47:07 +08:00
MinerYang
389a8c49f4
update artifact_type column alteration (#20239)
update column if is null

Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2024-04-08 14:25:19 +08:00
MinerYang
680a6a828b
bump golang 1.21.8 on main (#20197)
bump golang 1.21.8

Signed-off-by: yminer <yminer@vmware.com>
2024-04-02 10:22:03 +08:00
MinerYang
a269b4f31c
Update support for artifactType for both manifest and index (#20030)
add artifact_type for artifact model to support artifactType filter

Signed-off-by: yminer <yminer@vmware.com>

add 2.11 sql schema & update index artifactType omitted

Signed-off-by: yminer <yminer@vmware.com>

update UT

update migrate sql for artifact_type

Signed-off-by: yminer <yminer@vmware.com>

remove debug line
2024-03-12 13:52:56 +00:00
guangwu
6ca30a3732
fix: typos (#20106)
Signed-off-by: guangwu <guoguangwu@magic-shield.com>
2024-03-11 16:28:23 +08:00
stonezdj(Daojun Zhang)
29cdc398e0
Check if the internal_tls_config is not null when get strong_ssl_ciph… (#20032)
Check if the internal_tls_config is not null when get strong_ssl_cipher value

Signed-off-by: stonezdj <daojunz@vmware.com>
Co-authored-by: stonezdj <daojunz@vmware.com>
2024-02-26 09:46:40 +00:00
stonezdj(Daojun Zhang)
2b6608fb52
Move strong_ssl_ciphers to top level in harbor.yaml (#19914)
fixes #19912

Signed-off-by: stonezdj <stonezdj@gmail.com>
2024-02-26 05:08:35 +00:00
Shengwen YU
bca9b14bbf
feat: enable configuration of skip_java_db_update (#19996)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2024-02-21 10:13:52 +08:00
MinerYang
84b31aaf7f
remove ipfamily config migrate jinja in 2.9 and 2.10 (#19949)
remove ipfamily config migrate in 2.9 and 2.10

Signed-off-by: yminer <yminer@vmware.com>
2024-02-07 16:41:16 +08:00
MinerYang
a3e1b1eb79
add ip_family config in harbor.yml (#19934)
add ipFamily config in values.yaml

Signed-off-by: yminer <yminer@vmware.com>

update name

update prepare and migration

update comments

Signed-off-by: yminer <yminer@vmware.com>

remove print msg

update migrate template

update default value

update migrating template
2024-02-02 18:15:25 +08:00
MinerYang
522f96b5cf
add v6 port for nginx and portal config (#19868)
add v6 port for nginx ad portal config

Signed-off-by: yminer <yminer@vmware.com>
2024-01-24 09:24:42 +00:00
Liang Zheng
4378c15b1c
fix invalid links in harbor.yml.tmpl (#19786)
Signed-off-by: Liang Zheng <zhengliang0901@gmail.com>
2024-01-04 06:55:42 +00:00
Yang Jiao
aefe1bce9d
Bump up PostgreSQL from 14 to 15 (#19789)
Fix #19512

Signed-off-by: Yang Jiao <yang.jiao@broadcom.com>
Co-authored-by: Yang Jiao <yang.jiao@broadcom.com>
2024-01-04 14:01:00 +08:00
Yang Jiao
e397e86478
Fix docker version to 20.10.10 (#19751)
Signed-off-by: Yang Jiao <yang.jiao@broadcom.com>
Co-authored-by: Yang Jiao <yang.jiao@broadcom.com>
2023-12-26 16:57:25 +08:00
MinerYang
b38de22054
bump golang 1.21.5 & fix golangci-lint error (#19722)
bump golang 1.21.5

update golangci-lint && fix revive error

fix white space lint

Signed-off-by: yminer <yminer@vmware.com>
2023-12-19 09:41:26 +08:00
Wang Yan
aa1f79cd0c
bump distribution (#19669)
Bump up the distribution to v2.8.3

Signed-off-by: wang yan <wangyan@vmware.com>
2023-12-11 10:11:39 +08:00
MinerYang
3b127bc477
fix 2.10 prepare migration version (#19665)
fix 2.10 prepare migration

Signed-off-by: yminer <yminer@vmware.com>
2023-12-05 15:31:17 +08:00
MinerYang
9875965837
add prepare migration script for 2.10 (#19600)
Signed-off-by: yminer <yminer@vmware.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
2023-11-22 13:58:45 +08:00
Chlins Zhang
43ccd2f09f
perf: optimize the performance of accessory query (#19557)
1. Add db index for subject_artifact_id in table artifact_accessory.
2. Optimize the SQL of excluding the accessory for artifact count.

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-11-22 02:11:11 +00:00
MinerYang
17c17ffd8e
bump golang to 1.21.4 (#19601)
Signed-off-by: yminer <yminer@vmware.com>
2023-11-21 19:23:16 +08:00
MinerYang
193b00b9e6
bump golang to 1.21.3 (#19504)
update ut mock

update go mod

Signed-off-by: yminer <yminer@vmware.com>
2023-10-31 15:01:23 +08:00
MinerYang
1f975edb9c
bump golang to 1.20.10 (#19430)
Signed-off-by: yminer <yminer@vmware.com>
2023-10-11 13:05:31 +08:00
Wang Yan
ed370a496b
deprecate resource label (#19349)
There is no api is using the DAO, remove it from the source code.

Signed-off-by: wang yan <wangyan@vmware.com>
2023-09-14 01:25:52 +08:00
MinerYang
eb0724d130
fix storage.redirect.disable migrate template error (#19335)
Signed-off-by: yminer <yminer@vmware.com>

update boolean to lowercase
2023-09-12 03:56:12 +00:00
Chlins Zhang
c7e25295fe
fix: support customize cache db for business (#19182)
Support to configure the customized redis db for cache layer and other
misc business for core, by default the behavior is same with
previous(stored in db 0).

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-08-18 11:04:16 +08:00
Chlins Zhang
56f6c27c4f
chore: fix incorrect otel timeout in harbor yaml template (#19120)
Update the incorrect otel timeout sample value in the harbor YAML
configuration template.

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-08-16 16:26:16 +08:00
MinerYang
b8f2ef9c9e
bump golang 1.20.7 on main (#19111)
Signed-off-by: yminer <yminer@vmware.com>
2023-08-07 15:40:44 +08:00
stonezdj(Daojun Zhang)
0e92eaea18
Sort most dangerous vulnerabilities by score and severity level (#19103)
Check it is referred by a scan_report
  Add index to report_vulnerability_record to improve performance
  Fixes #19014 #19028

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-08-07 10:13:34 +08:00
MinerYang
e1c1f5625d
bump golang 1.20.6 on main (#19066)
bump golang 1.20.6

Signed-off-by: yminer <yminer@vmware.com>
2023-08-02 11:01:32 +08:00
Yang Jiao
5e130bd06c
Bump up photon version from 4.0 to 5.0 (#19006)
Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-08-01 11:52:33 +08:00
Alexis Leroux
84a131773a
Conserve sentinel_master_set value between upgraded versions (#18875)
fix(migration): Conserve sentinel_master_set value between upgraded versions

Signed-off-by: Alexis Leroux <alexis.leroux@worldline.com>
Co-authored-by: Alexis Leroux <alexis.leroux@worldline.com>
Co-authored-by: MinerYang <yminer@vmware.com>
2023-07-27 18:35:01 +08:00
MinerYang
3af605eedc
update installation hint (#19024)
Signed-off-by: yminer <yminer@vmware.com>
2023-07-27 10:41:05 +08:00
stonezdj(Daojun Zhang)
c25a7ca68d
Skip to run migrate script when data available (#18976) 2023-07-25 19:41:35 +08:00
MinerYang
8102304621
add migration script for 2.9 (#18997)
add miigration script for 2.9

Signed-off-by: yminer <yminer@vmware.com>

update quota_update_provider

update typo

update comment
2023-07-25 17:52:37 +08:00
Yang Jiao
70554fe4f1
Fix build harbor-db-base error (#19003)
Fix #19002

Signed-off-by: Yang Jiao <jiaoya@vmware.com>
2023-07-25 16:45:23 +08:00
Shengwen YU
320c0d63ca
feat: add config for job_loggers (#18970)
Signed-off-by: Shengwen Yu <yshengwen@vmware.com>
2023-07-24 22:10:36 +08:00
Chlins Zhang
8ff095d68f
feat: add the configuration for quota update provider (#18928)
Add the related configurations for the quota update provider to the
harbor.yml.

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-07-24 16:28:19 +08:00
stonezdj(Daojun Zhang)
5e4163b53b
Create index in vulnerability_record table (#18949)
add index for better query performance

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-07-20 14:00:40 +08:00
Chlins Zhang
970bdab936
fix: correct the operator in the webhook payload (#18906)
Fix the incorrect or meaningless operator in the webhook payload.

Fixes: #18438

Signed-off-by: chlins <chenyuzh@vmware.com>
2023-07-19 15:40:29 +08:00
stonezdj(Daojun Zhang)
d4aa9b13c4
Add vulnerability search API (#18924)
use q.Query to pass all query conditions

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-07-19 10:17:14 +08:00
stonezdj(Daojun Zhang)
d84b1d07d2
Update table scan_report and extract cvss_v3_score from vendor attribute (#18854)
For better performance when query cve information, add summary information to scan_report
    Extract cve_score from vendor attribute in vulnerability_record
    SQL migrate script for the update

Signed-off-by: stonezdj <daojunz@vmware.com>
2023-06-29 17:30:50 +08:00
MinerYang
14192dfb06
add strong_ssl_ciphers for nginx https jinja template (#18748)
Signed-off-by: yminer <yminer@vmware.com>
2023-05-29 21:57:15 +08:00
Stephan Hohn
4f3393e615
http2 enabled and ciphers changed to get an A+ rating instead of B fr… (#16990)
* Make strong cipher cfg optional
Signed-off-by: Stephan Hohn <stephan.hohn@tech11.com>

---------

Signed-off-by: Stephan Hohn <stephan.hohn@tech11.com>
Signed-off-by: MinerYang <yminer@vmware.com>
Co-authored-by: Stephan Hohn <stephan.hohn@tech11.com>
Co-authored-by: Wang Yan <wangyan@vmware.com>
Co-authored-by: MinerYang <yminer@vmware.com>
2023-05-29 10:37:57 +08:00
malmor
135ca37e3f
Add support for TLSv1.3 in nginx configurations (#18659)
Signed-off-by: malmor <62105800+malmor@users.noreply.github.com>
Co-authored-by: MinerYang <yminer@vmware.com>
2023-05-26 10:29:54 +08:00
David van der Spek
982ff0aeea
chore: bump registry release to 2.8.2 (#18685)
Signed-off-by: David van der Spek <vanderspek.david@gmail.com>
2023-05-26 09:37:45 +08:00