Intent to remove old builds on July 1, 2018

catlee · May 23, 2018, 9:15pm

As part of a project to clean out obsolete artifacts from archive.mozilla.org, we intend to remove old files from https://archive.mozilla.org/pub/b2g/ on July 1, 2018.

On July 1 we will:

Delete all files under https://archive.mozilla.org/pub/b2g/tinderbox-builds/
Delete everything except latest-mozilla-central* from https://archive.mozilla.org/pub/b2g/nightly/

If removing these files will seriously impact you, please reply back to me and we can hopefully find a way to preserve the files you need while still cleaning up the majority of the old builds there.

Thanks,
Chris

james.haggerty · May 28, 2018, 9:23am

I currently have latest-mozilla-b2g44_v2_5-flame-kk/ on my phone. Would be nice to keep this as the last ‘stable’ release of FirefoxOS (and it postdates a lot of the blobs in latest-mozilla-central*, including latest-mozilla-central-flame-kk/ !). Perhaps all the latest--v2_2 and latest--v2_5 directories?

madbilly · May 29, 2018, 9:38pm

Hi Catlee,

I agree with James’ suggestion to keep the latest “stable” build of each major version for each device. I started to try and make a summary of these. The best I could make myself were these site maps I posted on https://forum.xda-developers.com/firefox-os/general/chance-to-firefoxos-b2gos-nightly-builds-t3795123/

EDIT: see next post.

As well as my post on XDA I also posted on reddit to ask anyone who has a need for any files to post here or in the mailing list.

Cheers

madbilly · June 11, 2018, 9:57am

I tried to make a summary of the latest builds for each release branch and each target. I’ve no idea if this is complete or correct, or even if it’s useful to anyone.

EDIT: Desktop/Simulator/Mulet builds now added.

No project branches are included since I believe these were all merged or cancelled as dead ends.

The table isn’t displaying properly in Discourse because of the limited width of the view, but if you look at the HTML you can see the full table.

Latest builds from archive.mozilla.org

FxOS version/branch

mozilla-central

b2g-ota

b2g44_v2_5

b2g37_v2_2r

b2g37_v2_2

b2g34_v2_1s

b2g34_v2_1

b2g32_v2_0

b2g30_v1_4

b2g28_v1_3t

b2g28_v1_3

b2g26_v1_2f

b2g26_v1_2

b2g18_v1_1_0_hd

b2g18_v1_0_1

b2g18_v1_0_0

b2g18

Device/build

Desktop/Simulator/Mulet

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g37_v2_2r/

https://archive.mozilla.org/pub/b2g/nightly/2015/08/2015-08-06-03-25-03-mozilla-b2g37_v2_2/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-06-00-12-43-mozilla-b2g34_v2_1s/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4/

https://archive.mozilla.org/pub/b2g/nightly/2014/09/2014-09-04-02-40-03-mozilla-b2g28_v1_3/

https://archive.mozilla.org/pub/b2g/nightly/2013/12/2013-12-17-00-40-02-mozilla-b2g26_v1_2f/

https://archive.mozilla.org/pub/b2g/nightly/2014/06/2014-06-09-03-40-41-mozilla-b2g26_v1_2/

https://archive.mozilla.org/pub/b2g/nightly/2013/10/2013-10-09-04-22-04-mozilla-b2g18_v1_1_0_hd/

https://archive.mozilla.org/pub/b2g/nightly/2013/09/2013-09-06-04-32-05-mozilla-b2g18_v1_0_1/

https://archive.mozilla.org/pub/b2g/nightly/2013/02/2013-02-21-07-02-03-mozilla-b2g18_v1_0_0/

https://archive.mozilla.org/pub/b2g/nightly/2013/10/2013-10-09-04-12-03-mozilla-b2g18/

dolphin

https://archive.mozilla.org/pub/b2g/nightly/2015/08/2015-08-06-03-02-07-mozilla-central-dolphin/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g34_v2_1s-dolphin/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-dolphin/

dolphin-512

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g34_v2_1s-dolphin-512/

dolphin-512-eng

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g34_v2_1s-dolphin-512-eng/

dolphin-eng

https://archive.mozilla.org/pub/b2g/nightly/2015/08/2015-08-06-03-02-07-mozilla-central-dolphin-eng/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g34_v2_1s-dolphin-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-dolphin-eng/

emulator

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-emulator/

https://archive.mozilla.org/pub/b2g/nightly/latest-b2g-ota-emulator/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g37_v2_2r-emulator/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-emulator/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-emulator/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-emulator/

emulator-debug

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-emulator-debug/

https://archive.mozilla.org/pub/b2g/nightly/latest-b2g-ota-emulator-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-04-mozilla-b2g37_v2_2r-emulator-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-emulator-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-emulator-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-emulator-debug/

emulator-jb

https://archive.mozilla.org/pub/b2g/nightly/2015/03/2015-03-17-07-33-44-mozilla-central-emulator-jb/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator-jb/

https://archive.mozilla.org/pub/b2g/nightly/2015/04/2015-04-21-00-12-02-mozilla-b2g34_v2_1s-emulator-jb/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-emulator-jb/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-emulator-jb/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-emulator-jb/

emulator-jb-debug

https://archive.mozilla.org/pub/b2g/nightly/2015/03/2015-03-17-07-33-44-mozilla-central-emulator-jb-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator-jb-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/04/2015-04-21-00-12-02-mozilla-b2g34_v2_1s-emulator-jb-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-emulator-jb-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-emulator-jb-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-emulator-jb-debug/

emulator-kk

https://archive.mozilla.org/pub/b2g/nightly/2015/03/2015-03-17-07-33-44-mozilla-central-emulator-kk/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator-kk/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-00-12-04-mozilla-b2g34_v2_1s-emulator-kk/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-emulator-kk/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-emulator-kk/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-emulator-kk/

emulator-kk-debug

https://archive.mozilla.org/pub/b2g/nightly/2015/03/2015-03-17-07-33-44-mozilla-central-emulator-kk-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator-kk-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-00-12-04-mozilla-b2g34_v2_1s-emulator-kk-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-emulator-kk-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-emulator-kk-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-emulator-kk-debug/

emulator-l

https://archive.mozilla.org/pub/b2g/nightly/2015/03/2015-03-17-07-33-44-mozilla-central-emulator-l/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-27-15-25-05-mozilla-b2g37_v2_2r-emulator-l/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator-l/

emulator-l-debug

https://archive.mozilla.org/pub/b2g/nightly/2015/03/2015-03-17-07-33-44-mozilla-central-emulator-l-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-27-15-25-05-mozilla-b2g37_v2_2r-emulator-l-debug/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-30-03-25-03-mozilla-b2g37_v2_2-emulator-l-debug/

flame

https://archive.mozilla.org/pub/b2g/nightly/2014/10/2014-10-08-04-02-03-mozilla-central-flame/

https://archive.mozilla.org/pub/b2g/nightly/2014/10/2014-10-08-00-02-02-mozilla-b2g32_v2_0-flame/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-13-16-02-03-mozilla-b2g30_v1_4-flame/

flame-eng

https://archive.mozilla.org/pub/b2g/nightly/2014/10/2014-10-08-04-02-03-mozilla-central-flame-eng/

https://archive.mozilla.org/pub/b2g/nightly/2014/10/2014-10-08-00-02-02-mozilla-b2g32_v2_0-flame-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-13-16-02-03-mozilla-b2g30_v1_4-flame-eng/

flame-kk

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-flame-kk/

https://archive.mozilla.org/pub/b2g/nightly/latest-b2g-ota-flame-kk/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g44_v2_5-flame-kk/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g37_v2_2r-flame-kk/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g37_v2_2-flame-kk/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-flame-kk/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-flame-kk/

flame-kk-eng

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-flame-kk-eng/

https://archive.mozilla.org/pub/b2g/nightly/latest-b2g-ota-flame-kk-eng/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g44_v2_5-flame-kk-eng/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g37_v2_2r-flame-kk-eng/

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g37_v2_2-flame-kk-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-flame-kk-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-22-16-02-01-mozilla-b2g32_v2_0-flame-kk-eng/

hamachi

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-01-02-25-mozilla-central-hamachi/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-25-09-mozilla-b2g37_v2_2-hamachi/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-24-37-mozilla-b2g34_v2_1-hamachi/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-02-02-mozilla-b2g32_v2_0-hamachi/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-02-06-mozilla-b2g30_v1_4-hamachi/

hamachi-eng

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-01-02-25-mozilla-central-hamachi-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-25-09-mozilla-b2g37_v2_2-hamachi-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-24-37-mozilla-b2g34_v2_1-hamachi-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-02-02-mozilla-b2g32_v2_0-hamachi-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/02/2015-02-04-00-02-06-mozilla-b2g30_v1_4-hamachi-eng/

helix

https://archive.mozilla.org/pub/b2g/nightly/2015/01/2015-01-30-01-02-10-mozilla-central-helix/

https://archive.mozilla.org/pub/b2g/nightly/2015/01/2015-01-30-00-25-01-mozilla-b2g37_v2_2-helix/

https://archive.mozilla.org/pub/b2g/nightly/2015/01/2015-01-30-00-12-02-mozilla-b2g34_v2_1-helix/

https://archive.mozilla.org/pub/b2g/nightly/2015/01/2015-01-30-00-02-04-mozilla-b2g32_v2_0-helix/

https://archive.mozilla.org/pub/b2g/nightly/2015/01/2015-01-30-00-02-25-mozilla-b2g30_v1_4-helix/

nexus-4

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-nexus-4/

https://archive.mozilla.org/pub/b2g/nightly/2015/08/2015-08-10-03-25-04-mozilla-b2g37_v2_2-nexus-4/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-nexus-4/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-23-00-02-07-mozilla-b2g32_v2_0-nexus-4/

https://archive.mozilla.org/pub/b2g/nightly/2015/05/2015-05-14-00-02-02-mozilla-b2g30_v1_4-nexus-4/

nexus-4-eng

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-nexus-4-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/08/2015-08-10-03-25-04-mozilla-b2g37_v2_2-nexus-4-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/07/2015-07-24-00-12-07-mozilla-b2g34_v2_1-nexus-4-eng/

nexus-5-l

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-nexus-5-l/

https://archive.mozilla.org/pub/b2g/nightly/2015/08/2015-08-10-03-25-04-mozilla-b2g37_v2_2-nexus-5-l/

nexus-5-l-eng

https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-central-nexus-5-l-eng/

https://archive.mozilla.org/pub/b2g/nightly/2015/08/2015-08-10-03-25-04-mozilla-b2g37_v2_2-nexus-5-l-eng/

madbilly · June 13, 2018, 9:07am

@catlee, Have you made any changes about what you’re going to keep, is it still as described in the OP?

catlee · June 20, 2018, 6:55pm

Hi,

If we keep all the latest* directories, what builds are still left that would be useful?

Thanks,

Chris

madbilly · June 21, 2018, 7:29am

Hi Chris,

I think that all of the builds I listed in the table in my post above would be useful to keep. That table gives the latest build of every combination of device/branch (except project branches) within the archive. AFAIK the latest* builds are only from trunk and are probably less stable than the branches and as a result less useful (they may have been successful builds, but may still be full of bugs, unlike the branches which were feature-frozen and bugs fixed to improve their stability).

It would be very helpful and much appreciated if you could confirm explicitly (build by build) what you’re going to keep ~1 week in advance of you deleting everything else.

Thanks

catlee · June 22, 2018, 2:20am

latest* would include directories such as https://archive.mozilla.org/pub/b2g/nightly/latest-mozilla-b2g44_v2_5-flame-kk-eng/, no?

madbilly · June 22, 2018, 7:18am

Yes it would, excuse me I didn’t recheck and assumed it was the same as in the OP.

Saving latest* only saves two versions of the desktop/simulator/mulet build, only a few emulators, no branches earlier than 2.1 and none of the Hamachi or Helix device builds.

With latest* you’d be keeping 40 builds I think (including project branches). My suggestions in the table above would add ~90 builds. The total number of builds in the archive is ~62000, so my suggestion is to save ~0.15% of the archive instead of 0.07%.

catlee · June 22, 2018, 2:21pm

Could you get that table to me in list form? It will be much easier for automation to consume that way

madbilly · June 22, 2018, 2:58pm

I thought you’d never ask

There are some oddities, like there are no builds of 1_3t but lots of results txt.gz files saying “success”, was there a previous clearout or have I missed something?

Cheers

catlee · June 22, 2018, 9:57pm

I filed https://bugzilla.mozilla.org/show_bug.cgi?id=1470575 to track this work.

madbilly · August 3, 2018, 7:11am

@catlee and :oremj (can’t find his username in discourse) - thanks

madbilly · October 30, 2018, 3:35pm

@catlee I realised that there are some repos in GitHub which included links to some of the builds which have been removed.

I know I’m a bit late with this and I should have thought of this before. Is there any way they can be reinstated? If yes, how should I got about raising this request?

The alternative is these repos are updated with reference to existing builds that are confirmed to work. However, I think that is unrealistic, may be @lissyx can confirm?

lissyx · October 30, 2018, 3:42pm

It’s way too late. You’d better rebuild yourself, it should still be possible.

madbilly · October 31, 2018, 3:06pm

Fair enough, I thought I would be. On closer inspection the only ones which I think are essential for building are those that reference ftp.mozilla.org to download the SDK. These are:

Gaia makefile: https://github.com/mozilla-b2g/gaia/blob/master/Makefile
The Makefile references a different SDK depending on which branch it’s for. Any reason why the makefile references a specific date rather than just latest in a branch, e.g. the master branch needs v39? The archive does still contain the latest for some branches, so this should be an easy fix to the Makefile in most cases, if the latest SDK in each branch is a suitable substitute.

There’s also https://github.com/mozilla-b2g/B2G/blob/master/tools/mach_b2g_bootstrap.py which references the SDK for B2G43. Unfortunately there’s not a copy of the v43 SDK in the archive anymore. Why would v43 be essential, not just the latest version?

There could be other important instances hidden in various branches but GitHub doesn’t search them so I couldn’t find them practicably.

As you said, we should be able to build these SDKs. It would still be nice to have them available in the archive to avoid having to build them.