ansible/hg-ssh: stop generating bzip2 bundles (
bug 1354311); r?glob
The bzip2 bundles take a long time to generate and don't yield as good
compression as zstd. The bzip2 bundles exist to allow users to download
a smaller bundle. However, they aren't widely used because it requires
an explicit client-side config to prioritize them over gzip and zstd.
Since zstd is a better smaller bundle, let's remove the generation of
bzip2 bundles.
FWIW, I've already made this change on the server because of the
conversion of repos to generaldelta. The bundle generation code
uses ``bzip-v1`` as the bundle type. Using this against a generaldelta
repo would require several hours of CPU, which is why I disabled it.
MozReview-Commit-ID: BpG7JYpaCf6
--- a/ansible/roles/hg-ssh/files/bundle-repos
+++ b/ansible/roles/hg-ssh/files/bundle-repos
@@ -1,25 +1,25 @@
-mozilla-central bzip2 zstd_max
+mozilla-central zstd_max
integration/fx-team
integration/mozilla-inbound
integration/b2g-inbound
releases/mozilla-release
-releases/mozilla-aurora bzip2
-releases/mozilla-beta bzip2
+releases/mozilla-aurora
+releases/mozilla-beta
releases/mozilla-esr52
-releases/mozilla-esr45 bzip2
+releases/mozilla-esr45
releases/mozilla-esr38
releases/mozilla-esr31
mozilla-unified zstd_max
build/tools zstd_max
build/mozharness zstd_max
build/talos zstd_max
hgcustom/version-control-tools zstd_max
-comm-central bzip2 zstd_max
+comm-central zstd_max
projects/ash
projects/cedar
projects/holly
projects/jamun
projects/larch
projects/oak
releases/mozilla-b2g34_v2_1
releases/mozilla-b2g37_v2_2
--- a/docs/hgmo/bundleclone.rst
+++ b/docs/hgmo/bundleclone.rst
@@ -60,17 +60,17 @@ Bundle Attributes on hg.mozilla.org
-----------------------------------
On ``hg.mozilla.org``, following attributes are defined in the manifest:
BUNDLESPEC
This defines the type of bundle.
We currently generate bundles with the following specifications:
- ``zstd-v2``, ``gzip-v1``, ``gzip-v2``, ``bzip2-v1``, ``none-packed1``.
+ ``zstd-v2``, ``gzip-v1``, ``gzip-v2``, ``none-packed1``.
REQUIRESNI
Indicates whether the URL requires SNI (a TLS extension). This is set
to ``true`` for URLs where multiple certificates are installed on the
same IP and SNI is required. It is undefined if SNI is not required.
ec2region
The EC2 region the bundle file should be served from. We support
@@ -105,18 +105,17 @@ Here is an example *clone bundles* manif
As you can see, listed bundle URLs vary by bundle type (compression and
format) and location. For each repository we generate bundles for, we
generate:
1. A zstd bundle (either default compression or maximum compression depending
on repo utilization)
2. A gzip bundle (the default compression format)
-3. A bzip2 bundle (smaller, but slower)
-4. A *streaming* bundle file (larger but faster)
+3. A *streaming* bundle file (larger but faster)
For each of these bundles, we upload them to the following locations:
1. CloudFront CDN
2. S3 in us-west-2 region
3. S3 in us-west-1 region
4. S3 in us-east-1 region
5. S3 in eu-central-1 region