Closed
Bug 734532
Opened 13 years ago
Closed 13 years ago
split releng public repository into distro-version-arch repositories
Categories
(Infrastructure & Operations :: RelOps: General, task)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: jhford, Assigned: dustin)
References
Details
Attachments
(1 file, 2 obsolete files)
(deleted),
patch
|
dustin
:
review+
catlee
:
checked-in+
|
Details | Diff | Splinter Review |
We currently have a need for releng generated rpms. Currently, there is only one repository for all releng generated rpms. Instead of using one repository that has the rpms for both distributions and all archs in one repository, we should have a releng-public repository for each combination of distribution and release. we should move from having one repository
http://$config::yum_server/repos/yum/releng/public/noarch
to having something like:
http://$config::yum_server/repos/yum/releng/public/CentOS/6/i386
http://$config::yum_server/repos/yum/releng/public/CentOS/6/x86_64
http://$config::yum_server/repos/yum/releng/public/Fedora/16/i386
http://$config::yum_server/repos/yum/releng/public/Fedora/16/x86_64
Because these RPMs are written by us, I think we should make an SRPM repository available, as a lower priority.
We'll need to figure out how to get releng generated rpms into this repository.
Comment 1•13 years ago
|
||
(In reply to John Ford [:jhford] from comment #0)
> Because these RPMs are written by us, I think we should make an SRPM
> repository available, as a lower priority.
Since some of the packages are distributed under terms of (L)GPL or similar licenses, once we start distributing compiled packages, we'll have to distribute the sources (SRPMs) as well to avoid license violations.
Reporter | ||
Comment 2•13 years ago
|
||
(In reply to Rail Aliiev [:rail] from comment #1)
> (In reply to John Ford [:jhford] from comment #0)
> > Because these RPMs are written by us, I think we should make an SRPM
> > repository available, as a lower priority.
>
> Since some of the packages are distributed under terms of (L)GPL or similar
> licenses, once we start distributing compiled packages, we'll have to
> distribute the sources (SRPMs) as well to avoid license violations.
Yep, for now these are internal repos, but having them world-readable is definitely something we want!
Updated•13 years ago
|
Assignee: server-ops-releng → dustin
Reporter | ||
Comment 3•13 years ago
|
||
Turns out that if we build the repository with the srpms and debuginfo packages inside, doing |yumdownloader --source| and |debuginfo-install| both work for our packages
Reporter | ||
Comment 4•13 years ago
|
||
The existing repo has been commented out because it's cause many problems
Assignee | ||
Comment 5•13 years ago
|
||
Is there a particular reason not to just put all of the distro/arch packages in the same repo? I've no problem with this, except that it's more repos to juggle, but I'm curious why.
(In reply to John Ford [:jhford] from comment #3)
> Turns out that if we build the repository with the srpms and debuginfo
> packages inside, doing |yumdownloader --source| and |debuginfo-install| both
> work for our packages
Does this mean that we don't need separate SRPMs directories?
(In reply to John Ford [:jhford] from comment #4)
> The existing repo has been commented out because it's cause many problems
Can you elaborate, or point to bugs?
Reporter | ||
Comment 6•13 years ago
|
||
(In reply to Dustin J. Mitchell [:dustin] from comment #5)
> Is there a particular reason not to just put all of the distro/arch packages
> in the same repo? I've no problem with this, except that it's more repos to
> juggle, but I'm curious why.
We currently run centos6.2 and are using fedora16, but that doesn't mean we'll only ever use fedora16 and centos6.2. This won't result in any extra repositories at this time because we only have one version per distro-arch.
> (In reply to John Ford [:jhford] from comment #3)
> > Turns out that if we build the repository with the srpms and debuginfo
> > packages inside, doing |yumdownloader --source| and |debuginfo-install| both
> > work for our packages
>
> Does this mean that we don't need separate SRPMs directories?
Look like it, yes.
> (In reply to John Ford [:jhford] from comment #4)
> > The existing repo has been commented out because it's cause many problems
>
> Can you elaborate, or point to bugs?
I re-enabled it. I this repo was broken in mtv1 but works in scl1. It was stopping me from being able land changes and test them post-landingl.
Reporter | ||
Comment 7•13 years ago
|
||
aiui, the only thing that is being managed by puppet is the creation of the directories that hold the repositories. I think this patch does it, but I cannot test that.
Attachment #608117 -
Flags: review?(arich)
Assignee | ||
Comment 8•13 years ago
|
||
Comment on attachment 608117 [details] [diff] [review]
create mirrors
I'd rather name this 'releng' to differentiate it from the mozilla repos on mrepo.mozilla.org. So, basically, s!/mozilla/!/releng/public/! and remove the resulting duplicate line.
What does the comment mean? Are those not authoritative for some reason?
Attachment #608117 -
Flags: review?(arich) → review-
Comment 9•13 years ago
|
||
the mock configurations will need updating once we get the URLs for these figured out
Blocks: 759975
Comment 10•13 years ago
|
||
(In reply to Dustin J. Mitchell [:dustin] from comment #8)
> Comment on attachment 608117 [details] [diff] [review]
> create mirrors
>
> I'd rather name this 'releng' to differentiate it from the mozilla repos on
> mrepo.mozilla.org. So, basically, s!/mozilla/!/releng/public/! and remove
> the resulting duplicate line.
Agreed
> What does the comment mean? Are those not authoritative for some reason?
I don't know what John meant here. Perhaps that these aren't official centos/fedora repos?
Assignee | ||
Comment 11•13 years ago
|
||
The sysadmins puppet no longer creates directories or does anything under /data other than synchronize it.
So there's no actual patch here, and all that remains is to figure out how to migrate this in a compatible fashion, which probably just requires some temporary symlinks and a plan to eliminate them later.
So, this can happen while I'm away, although I don't yet trust csync2 well enough to be confident it will sync flawlessly. Or, it can happen now.
Catlee, can you put together a patch for hgmo/build/puppet to change the repos and the mock configs appropriately?
Comment 12•13 years ago
|
||
Attachment #608117 -
Attachment is obsolete: true
Attachment #629807 -
Flags: review?(dustin)
Assignee | ||
Comment 13•13 years ago
|
||
Comment on attachment 629807 [details] [diff] [review]
add distro specific releng mirrors
Review of attachment 629807 [details] [diff] [review]:
-----------------------------------------------------------------
I think it would make more sense to construct the paths dynamically based on the OS and version, rather than use conditionals. I do like substituting the puppet factors into the URLs in puppet, so that the .repo files have real URLs in them that I can copy/paste.
Also, when did we grow a "Mozilla" repository? I think that's confusing, since we have a "Mozilla" repository on mrepo as well with different contents. That's why I created the "releng" repo. Also, the mozilla repo isn't on https://wiki.mozilla.org/ReleaseEngineering/PuppetAgain/Repositories. And why is there a copy of the puppet RPM in the releng repo? That RPM is in the puppetlabs repo, and isn't a custom RPM anyway.
Sorry, this is in much worse shape than I realized this morning.. we should get it cleaned up in this bug.
Attachment #629807 -
Flags: review?(dustin) → review-
Comment 14•13 years ago
|
||
Attachment #629807 -
Attachment is obsolete: true
Attachment #630167 -
Flags: review?(dustin)
Assignee | ||
Updated•13 years ago
|
Attachment #630167 -
Flags: review?(dustin) → review+
Updated•13 years ago
|
Attachment #630167 -
Flags: checked-in+
Updated•13 years ago
|
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Updated•11 years ago
|
Component: Server Operations: RelEng → RelOps
Product: mozilla.org → Infrastructure & Operations
You need to log in
before you can comment on or make changes to this bug.
Description
•