| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
|
|
|
| |
variable TEMPLATES.
RT: 105108 (reworked from)
Submitted by: Curtis Jewell<swordsman@csjewell.fastmail.us>
|
|
|
|
|
| |
- Set X11BASE to ${LOCALBASE} for recent ${OSVERSION}.
- Bump PORTREVISION for ports intalling files in ${X11BASE}.
|
|
|
|
|
| |
Reported by: miwi
Tested by: miwi
|
|
|
|
|
|
|
|
|
|
|
| |
with very long arguments (>400000 characters).
The problem reveals for example if
/usr/ports/Tools/scripts/rmport -d print/ghostscript-gnu
is executed - it does
printf "%s\n" "... 451109 chars ..."
Spotted by: rafan
|
|
|
|
|
|
|
|
| |
packages due to packages being trimmed by RESTRICTED.
While here, note that the 'missing' column will be off by the number of
duplicates in the other columns. This happens when partial builds are
restarted.
|
| |
|
|
|
|
|
| |
in the repository. Suggested by: gabor@
* Fix typo in the output
|
|
|
|
|
|
| |
process. Thankyou openoffice!
Pass in the jail IP address in the JAIL_ADDR environment variable
|
| |
|
|
|
|
|
| |
Set DISPLAY to the IP address instead of using the :<...> implied form.
This is required for jails.
|
|
|
|
| |
uname
|
|
|
|
| |
the command line
|
| |
|
| |
|
| |
|
|
|
|
|
|
|
| |
on a machine that has use_md_swap=1, allow for the possibility of reusing
a md between builds if md_persistent=1. This requires a patch from pjd
to support BIO_DELETE in md devices, but it is a big optimization when
it can be used.
|
|
|
|
|
|
|
| |
will completely erase the list.
When using -continue, don't append to the duds.errors, we don't want to
preserve the old cruft from a previous build
|
|
|
|
| |
now regularly take longer than this :(
|
| |
|
|
|
|
| |
configure step.
|
|
|
|
|
|
|
|
|
|
| |
There is no change in any of the individual terms; this is merely a
rearrangement.
This change undoes what I was trying to do back in 2004 of breaking up
each individual test into a grep, for readability. The performance of
the script has continued to suffer as new greps were added over time,
to the point where this is now a bad tradeoff.
|
| |
|
| |
|
|
|
|
|
|
|
| |
directories, but a 5% loss on smaller ones.
No code changes (yet) except for the deletion of one duplicate
("fetch: transfer timed out" -> "fetch_timeout".
|
| |
|
|
|
|
| |
alignment apxs assert CATEGORIES cgi-bin forbidden stl
|
|
|
|
|
| |
we are seeing on the latest -current runs. Saves 40 seconds of time on
those runs, at the cost of 4 on the others.
|
|
|
|
| |
still have processes running, and add that into the highlight logic.
|
| |
|
| |
|
|
|
|
| |
readable and use double quotes everywhere.
|
| |
|
|
|
|
|
|
| |
and continue with removal anyway. Requested by miwi@
* Pipe dependencies information (if any) through a PAGER because INDEX lines
are very long and hard to read when wrapped
|
|
|
|
| |
latest gcc test build.
|
|
|
|
| |
web-interface becase the later is not reliable.
|
|
|
|
|
| |
If any are found then ask if the port should be skipped from removal or
removed regardless of the PRs.
|
|
|
|
| |
happens when security.jail.sysvipc_allowed=0
|
|
|
|
| |
except in disguise.
|
|
|
|
| |
timezone.
|
|
|
|
|
| |
these scripts on the cluster, transfer maintainership of these
to myself.
|
|
|
|
|
|
|
| |
This script can sometimes take several hours to run on builder,
and thus leading to confusing of why it still reports an error
that was fixed in cvs some time ago. Including the time when
the ports tree was updated should reduce some of this confusion.
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
to be removed, possibly with the expiration date and deprecated reason
* If port is not marked for expiration than put "Removed" in ports/MOVED
entry instead of "Has expired"
* Implement -a option to remove all expired ports
* Ask if the cvs diff output should be recreated/reviewed again thus
giving the committer a chance to edit files by hand and view diff
results afterwards
* Cosmetic changes
|
|
|
|
|
| |
like .../barport/something e.g. expect either space, slash or eol after
port's name
|
|
|
|
|
| |
log' cell a link to it. My weak awk/sh skills are evident here, but it
does the job.
|
| |
|
|
|
|
| |
in addition to */*/Makefile* and ignore references in comments
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
* Add more XXX comments for future work
* Only record a cvsdone timestamp if we updated cvs
* When building with -trybroken, it's safe (and desirable) to run the
prunefailure script
* Reorganise a few things for better parallelism
* Instead of keeping a duplicate copy of the previous logs and errors
under bak/, just store a symlink to the archival location
* When doing an incremental build, also cycle out the old logs to avoid
broken links on the website (the logs from the previous build are
removed until the packages are rebuilt). Use cpio to create
hardlinked copies of the previous logs. XXX when these are bzipped
by cron to save space the links will be broken and it might actually
take more space.
* Don't bother bunzipping old logs, now that the processlogs scripts
can handle it. This was a waste of time anyway since they'd all be
rebzipped by the next nightly cron job.
* When the build is complete, stash a copy of the restricted ports in
bak/restricted/ before deleting them from packages/, and restore from
here when doing an incremental build to avoid needlessly rebuilding
them each time.
|
|
|
|
|
|
|
| |
127.0.0.0 or 127.0.0.1
* Don't use chroot to mount the linprocfs, or it won't be visible
within the jail.
|
|
|
|
|
| |
* More robust extraction of the header values (copes with the addition of
the build uname to the header)
|
|
|
|
|
|
|
| |
* Support .log.bz2 files
* Clarify that BROKEN ports are not frequently rebuilt so probably
won't appear
|
| |
|
|
|
|
|
|
|
|
|
|
| |
* Increase sparc64 build timeout to 24 hours (we have so few build
machines that we cannot afford to tie them up for longer)
* Increase other arch build timeout to 100 hours (hello openoffice!)
* If we successfully build a formerly broken package, touch errors/.force
which will kick off a rebuild of the html files
|
|
|
|
|
|
|
|
|
| |
* Use a generation number for the bindist tarballs, with compatibility
symlink. Eventually we'll use this to avoid building in a "stale"
chroot (i.e. populated by old world).
* Don't bother running ldconfig on i386, it is evidently not needed since
the other arches work fine without it
|
|
|
|
|
|
|
|
| |
* Don't try and mount/umount procfs, it won't work when we build inside a
jail.
* Report the uname -mr of the build environment, to ease confusion of
people reading the error logs by mail.
|
|
|
|
|
| |
* The 5.x variant for populating /etc does not work on 6.x and above, and
vice versa. Conditionalize old and new methods.
|
| |
|
| |
|
|
|
|
|
| |
dependencies. This needs some more polishing but for now it is better to
emit false positives than skip dependencies.
|
|
|
|
| |
fix true positive for "runaway_process".
|
|
|
|
|
| |
errors seen on -CURRENT as "compat6x" e.g. "someone needs to create a
compat6x port and then make it a dependency here."
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This commit should largele be a NOOP as it only adds support
for DESTDIR undefined. This does allow us to start testing
ports with DESTDIR set, but this is as of yet not supported.
Although this has been extensively tested on pointyhat, this
is a very intrusive change and some cases may have been
overlooked. Please contact Gabor and me if you find any.
PR: 100555
Submitted by: gabor
Sponsored by: Google Summer of Code 2006
|
| |
|
|
|
|
|
| |
Especialy i386 has enough horsepower to run two branches simultaniously.
This change has been on pointyhat for some time.
|
|
|
|
|
|
|
|
| |
${FILESDIR} which look like patches be treated as binary files. This
prevents RCS tags in patch fragments causing a problem for CVS.
Approved by: garga (maintainer),
ahze (mentor, implicit)
|
|
|
|
| |
a comment about openoffice.org*; generalize a bit.
|
| |
|
| |
|
| |
|
| |
|
|
|
|
|
| |
so do them separately in order not to break up the ease of browsing the
most important stats, above.
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
|
|
|
| |
break sed -E regular expressions
|
|
|
|
| |
to prevent spam
|
| |
|
| |
|
|
|
|
|
| |
number of packages built vs. packages that failed, along with some other
related information.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
- Remove obsolete explanations which are no longer seen, for speed:
ELF, MOTIF, MOTIFLIB, X_manpage, awk, bison, ffs_conflict, forbidden,
getopt, getopt.h, imake, lc_r, malloc.h, pod2man, sed, stl, soundcard.h,
texinfo, union_wait, values.h
- Add more cases to: arch, bad_c++, compiler_error, depend_object,
install_error, linker_error, mtree, perl5
These changes reduce many dozens of false positives; add a few dozen
true positives; and for certain directories, improve the speed about 10%
(a few drop by 15%).
It turns out that the performance issues are mainly due to the multiple
greps. If performance is an issue we need to go back to the moderately-
unreadable, everything-on-one-line paradigm. Before that happens, I would
like to experiment with some refactoring, so that the patterns are built up
in the shell line-by-line, so you could still be able to read it.
Tested on: pointyhat
Hat: portmgr
|
|
|
|
|
| |
Actually use ${SCP_DEST_TMP} to fix the case where
SCP_DEST_TMP != /tmp/
|
|
|
|
|
|
| |
When copying INDEX to the server, copy it first to a staging area and
first then to the real location. The copying can take long enough for
users to get a truncated file when downloading during the upload.
|
|
|
|
|
|
|
|
|
|
| |
time to add a new module. If you want to still use old way, just use
"-M freefall.FreeBSD.org" option
- Take addport maintainership
- When modulesupdate fail, ask user to retry
- Change modulesupdate to work fine with addport
Approved by: will (maintainer)
|
|
|
|
|
|
|
|
| |
filesystem (either absolute or relative) in addition to `category/port'.
PR: ports/96649
Submitted by: Cheng-Lung Sung <clsung@freebsd.org>
Reworked by: vd
|
|
|
|
|
|
| |
When removing category/port - look if other ports' Makefiles contain
`/port' rather than `category/port', since the later misses things
like `${.CURDIR}/../port'
|
| |
|
|
|
|
|
| |
export it ro. This saves thrashing the server if we accidentally try to
rm -rf a NFS mount (e.g. because a chroot cleanup failed).
|
|
|
|
| |
just takes up time.
|
|
|
|
| |
is started without arguments.
|
|
|
|
| |
can benefit (or suffer :-) from it.
|
| |
|
| |
|
|
|
|
| |
too much space on pointyhat, and it's also very slow.
|
| |
|
| |
|
|
|
|
|
|
|
|
| |
script, i.e. so they can be moved back into place before start the next
incremental build so they won't be needlessly rebuilt every time (jdk, I'm
looking at you). It is a bit of a hack since it relies on assumptions
about the structure of that shell script, but for now it's the best we
can do.
|
|
|
|
| |
Approved by: portmgr (implicit)
|
|
|
|
| |
Approved by: portmgr (implicit)
|
|
|
|
|
|
| |
clean themselves up properly.
Approved by: portmgr (implicit)
|
|
|
|
|
|
|
|
|
|
|
| |
server. Error conditions are flagged by other processes by creating
a named dotfile in ${scratchdir}. If these files are found, report the
error status instead of the number of running jobs. Currently report "ERR"
for all error conditions; I will probably change this to a per-condition
message.
Currently only "squid not running" and "disk space low" conditions are
reported.
|
|
|
|
|
|
|
| |
If the package copy fails, bail out immediately instead of later on when
we try to pkg_add it. Also trap signals and bail out.
Both conditions will cause a retry of the package build.
|
|
|
|
|
|
|
|
|
|
| |
If portbuild bailed out unexpectedly, mail the log to ${mailto}.
Add some XXX comments about improving robustness of this script.
Sleep for 2 minutes before retrying builds, to avoid spamming ${mailto}
with a high rate of failure logs. In future we might be smarter about
attempting to automatically correct common failure modes.
|
|
|
|
|
|
|
|
|
|
|
| |
* Test whether squid is running. If not, try to kick off
the rc script in the background in case it can be restarted
cleanly.
* Test for at least 100MB of free space on the scratch partition.
If either condition fails, set an exception flag and bail out. This
will be reported back to the server via reportload.
|
|
|
|
|
|
|
|
|
|
| |
cause is because it was specified in the list twice)
* Don't panic when the list of packages to delete becomes empty
* When unexpected filesystem changes are detected, bail immediately
instead of proceeding and hiding the error in the middle of
the log
|
| |
|
|
|
|
|
|
|
|
|
| |
with all the errors from broken pkg_delete scripts
* As threatened in previous commit, move the pristine mtree spec
generation to phase 1, and avoid having to delete and re-add the
FETCH_DEPENDS. We still have to keep them installed until after
'make extract' though
|
|
|
|
|
|
|
|
|
|
|
| |
arguments (cosmetic)
* Detect if a chroot was used to run a jailed build, and first attempt
to gracefully shut it down by killing everything within using pgrep(1)
This has a much higher chance of succeeding that relying on fstat to
identify processes that might interfere with our attempts to clean up
mountpoints, which is fragile (libkvm-dependent), and inherently
unreliable at best.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
in portbuild.conf (or per-machine .conf), then construct a 127.0.0.0/8
IP address based on the build directory ID (i.e. unique for each
build instance). This is bound to the lo0 interface for the duration
of the 'phase 2' build.
We cannot build 'phase 1' in a jail since 'make fetch' doesn't always
work through a proxy (e.g. squid sometimes mangles files fetched through
FTP, I think by performing CR/LF translation in FTP ASCII mode).
Pass in the HTTP_PROXY variable to the jail, if set. This allows FTP/HTTP
access from within the jail if the proxy is suitably configured (some ports
legitimately need to fetch additional files during the build, e.g. if they
have a BUILD_DEPENDS=...:configure target that needs to fetch additional
distfiles).
Not all ports can be built in jails (most notably the linux_base ports
since they want to mount/umount linprocfs), so we will need to come up
with a way to deal with this.
Some ports require SYSV IPC, so security.jail.sysvipc_allowed=1 might be
required. Some other ports attempt to perform DNS lookups, ping, or
outbound TCP connections during the build.
When it works, this provides better compartmentalization of package builds,
e.g. easier termination of builds without the possibility of daemonized
processes staying active; no possibility of accidental interference
between jails, etc. It also allows for admin monitoring using jls(1).
|
|
|
|
|
|
|
|
| |
* Remove old logs and possible compressed logs before attempting the build
Requested by: lofi [1]
Submitted by: linimon [1]
No more accidental portbuild spam: kris and krion [1]
|
|
|
|
|
|
| |
Requested by: lofi
Submitted by: linimon
No more accidental portbuild spam: kris and krion
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
* Only keep distfiles if the port passes 'make fetch', so we don't
accidentally keep files with invalid checksums
* Use cleanup() instead of directly exiting in some error conditions
* When cleanup() is called indicating an unexpected error (possibly
leaving the filesystem in an inconsistent state), mark the chroot
as dirty so it will not be reused by another build
* Remove packages in dependency order instead of with pkg_delete -f in
possibly incorrect order. This paves the way for focusing on errors
generated by pkg_delete (e.g. @dirrm that should be @dirrmtry) in the
future. [1]
* Detect when packages were left behind because they were still in use
by other packages, indicating an incorrect or incomplete port
dependency list
* Partial support for ccache builds (not yet complete)
* Support non-standard LOCALBASE/X11BASE settings
* Delete FETCH_DEPENDS after the 'make fetch' stage. We have to add
them again before 'make extract' since, due to a lack of a 'fetch
cookie', 'make extract' actually *always* runs 'make fetch' again,
even when distfiles have already been fetched. We need to delete
them in order to:
* Record an mtree spec of the 'pristine' filesystem state, for later
comparison.
# XXX Perhaps this can be done in stage 1 before the
# 'make fetch', removing the need to delete-and-readd.
* Also record an mtree spec of the filesystem state prior to the
build phase. Compare this to the state of the filesystem
immediately before running the install phase, to detect files
that were inappropriately installed during the build phase.
Doing so is a fatal error.
* Prior to installing, try to run a 'regression-test' port makefile
target, if it exists. This allows ports to hook their internal
regression suites into the package build. This needs further
infrastructure support, e.g. a default NOP target in bsd.port.mk.
For now this is run with 'make -k', so regression failures will
not yet actually cause package build failures.
* Separate the 'make install' from 'make package' phases rather than
let the latter implicitly do the install.
* After the newly packaged port has been deleted, compare the state
of the filesystem to the state before 'make install'.
* After removing BUILD and RUN dependencies, compare the filesystem
state to the pristine state before the start of the build. This
also detects package dependencies that did not clean themselves up
properly when deinstalling. It also detects dependencies that were
'missing' from the port INDEX: these were not pkg_added into place,
so the package build had to compile them from scratch (a big waste
of time and effort), so this is now also a fatal error.
PR: ports/85746 (inspired by) [1]
Submitted by: Boris B. Samorodov <bsam@ipt.ru> [1]
|
| |
|
|
|
|
| |
and this doesn't happen in practise unless you screwed up manually.
|
|
|
|
| |
some of the code
|
| |
|
|
|
|
|
|
| |
0 = don't clean chroot
1 = sanitize commonly-modified directories
2 = remove entire chroot
|
|
|
|
| |
in unclean state) and run clean-chroot on them to remove them.
|
|
|
|
| |
Noticed by: linimon
|
| |
|
|
|
|
| |
the client chroots.
|
| |
|
| |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
on the contents of the distinfo files.
#
# Small tool to find distinfo with missing MD5/SHA256/SIZE statements,
# based on the assumption that if there is one of the MD5/SHA256/SIZE
# statements, then there should be all of them (except for SIZE
# when MD5/SHA256 is set to IGNORE).
#
# Usage: distinfochecker [-v] [-d directory]
# -v - verbose (print)
# -d - use directory instead of /usr/ports
#
|
|
|
|
|
| |
Add a few more local configuration variables
Minor cleanups
|
|
|
|
|
|
| |
Use LOCALBASE/X11BASE values from buildenv
xorg uses the stock BSD.x11-4.dist now.
|
|
|
|
| |
required by any ports
|
| |
|
|
|
|
| |
Don't bother cleaning up doc mounts, they are not needed.
|
| |
|
| |
|
|
|
|
|
| |
PR: ports/64930
Submitted by: Damir Kiramov <damirycha@damirycha.net.ru>
|
| |
|
|
|
|
|
| |
PR: ports/64930
Submitted by: Damir Kiramov <damirycha@damirycha.net.ru>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
portsvar.sh
- print out variable defined through bsd.port.mk
example:
% portsvar.sh PORTSDIR OSVERSION
PORTSDIR = /usr/ports
OSVERSION = 600034
% portsvar.sh -e "PORTS[^_]"
PORTSDIR = /usr/ports
PORTSSUPFILE = /usr/share/examples/cvsup/ports-supfile
% portsvar.sh USE_RUBY=yes RUBY_VER RUBY_ARCH
RUBY_VER = 1.8
RUBY_ARCH = i386-freebsd6
% portsvar.sh -w ruby RUBY_VER RUBY_ARCH
RUBY_VER = 1.8
RUBY_ARCH = i386-freebsd6
% portsvar.sh -w kde -e KDE_
KDE_MAINTAINER = will@FreeBSD.org
KDE_ORIGVER = ${KDE_VERSION}
KDE_PREFIX = ${LOCALBASE}
KDE_VERSION = 3.5.0
MASTER_SITE_KDE_kde = ${kmaster:S@%SUBDIR%/@@g}
% portsvar.sh -a
list all variables through bsd.port.mk
% portsvar.sh -a -w kde
list all variables through bsd.port.mk including kde
portsvar.sh is easy tool to check out the variables used in
/usr/ports/Mk/bsd.*.mk.
|
|
|
|
|
| |
cache. This is useful if the client is holding a bad or stale cached
copy of a package that is causing problems for package builds.
|
|
|
|
| |
256MB. Clarify a comment.
|
| |
|
| |
|
|
|
|
| |
avoid problems with stale lockfiles after a reboot.
|
|
|
|
| |
to avoid problems with stale lockfiles after reboots.
|
| |
|
|
|
|
| |
doesn't completely prep the client.
|
|
|
|
| |
This avoids problems from stale lockfiles after reboots.
|
| |
|
|
|
|
|
|
|
|
|
|
| |
The ports tree contains many tools with almost-similar names
and no helpful pkg-descr difference. The goal of pkg-descr
would be to aid the user in his choice of port version.
Ergo, similar pkg-descr files are bad.
PR: ports/89432
Submitted by: Jonathan <afarsec@012.net.il>
|
| |
|
|
|
|
| |
queue lengths since that doesn't arise.
|
| |
|
| |
|
|
|
|
|
|
|
|
|
|
| |
and copy it to the client. This has two benefits:
1) Avoids spamming the master with dozens of md5 processes when
dosetupnode is spawned for all client machines at ocne
2) Avoids silly copy attempts on disconnected nodes for which the file
is copied to itself
|
|
|
|
| |
ever uncommented.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
portbuild.conf, builds will each be done in a separate swap-backed md.
This dramatically improves build performance since
* Every transaction is not written to disk, so disk bandwidth is not
a bottleneck
* Multiple builds do not contend with each other for the same set of
filesystem locks and other per-device resources
The size of the md devices is controlled by the md_size variable. '2g'
seems to be a good size.
Currently we mdconfig -u each device after each port build, since
otherwise dirty blocks accumulate and the md eventually uses a full
amount of backing store (2g in the above example). This is a problem
if there is unsufficient swap backing to accomodate them all.
XXX This should be made configurable to avoid the performance penalty on
systems that do have enough swap backing
|
| |
|
|
|
|
| |
process, you must use -k or lockf can give out two locks at once
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
around silly failures in some ports when it is present
* Add a footer to completed builds that is recognised by pdispatch to
retry truncated builds
* If ALWAYS_KEEP_DISTFILES is not present in the environment or port
makefile, then clean up DISTDIR after the build finishes, to prevent
collection of distfiles for this port.
* Finish flipping the switch on -noplistcheck - this is activated by
passing in the NOPLISTCHECK environment variable instead of
using PLISTCHECK in the opposite case
|
|
|
|
|
|
|
|
|
| |
passing in the NOPLISTCHECK environment variable instead of
using PLISTCHECK in the opposite case
* Remove the unused -nodummy function
* Pass in ALWAYS_KEEP_DISTFILES when -distfiles is set
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
* Finish flipping the switch on -noplistcheck - this is activated by
passing in the NOPLISTCHECK environment variable instead of
using PLISTCHECK in the opposite case
* Always pull in the distfiles from the client if they exist (needed
for forthcoming ports tree changes to satisfy GPL license requirements)
* If the build did not complete "cleanly", e.g. it was interrupted by a
network outage or client machine panic, then retry it until it succeeds
instead of just leaving a dirty truncated log
|
|
|
|
|
|
|
|
|
|
|
| |
* Finish flipping the switch on -noplistcheck; set NOPLISTCHECK instead
of PLISTCHECK in the opposite case
* Clean up the distfiles/ directory when starting build, so it is not
contaminated by old distfiles
* Remove commented-out code to don't back up old distfiles/ directory,
it's just too big to do this.
|
| |
|
| |
|
|
|
|
|
|
| |
commit message.
Approved by: will (maintainer)
|
|
|
|
|
|
| |
their feet off in public.
Suggested by: adamw
|
|
|
|
|
| |
PR: ports/85281
Submitted by: Vasil Dimov <vd@datamax.bg>
|
| |
|
| |
|
| |
|
| |
|
|
|
|
|
|
| |
Perl 5.8.7.
Reported by: mezz
|
|
|
|
| |
Approved by: sobomax
|
|
|
|
|
|
|
|
|
| |
directory
name contains upper-case characters as it makes finding a port harder.
PR: ports/79679
Approved by: will, portmgr(krion)
|
|
|
|
|
|
| |
patches to several appropriately named single-file patches.
Requested by: flz
|
|
|
|
|
|
|
|
|
|
| |
of ports which are depending on a port with a changed shared lib version.
Edwin dedicates this script to his son Dirk, born few days ago :)
Congrats (again) !
PR: ports/63915
Submitted by: edwin
|
|
|
|
|
|
|
|
| |
in the ports framework.
PR: ports/62767
Submitted by: Igor Pokrovsky <tiamat@comset.net>
Approved by: maintainer timeout (> 8 months)
|
|
|
|
| |
Clean up after we're done.
|
|
|
|
|
| |
symlinks are not created on the target) and rsync the entire
directory so that extra files are deleted.
|
|
|
|
|
|
|
| |
default) instead of /tmp, since some packages incorrectly search this
build path at runtime to try to load things.
Requested by: nectar
|
| |
|
|
|
|
| |
make it the default behaviour.
|
| |
|
|
|
|
|
|
| |
need them when building from 'addport -a -t'.
Approved by: will
|
| |
|
|
|
|
|
| |
Submitted by: Christopher Kelley <bsd at kelleycows.com>
Pointyhat to: krion
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
* Fix PATH problems during README.html generation if "make
-DPORTSTOP readmes" is defined. [2]
* Add support for early rcNG startup scripts. [3]
* Remove duplicate USE_XLIB handling. [4]
* Add check for USE_PYTHON_(BUILD|RUN), and include bsd.python.mk if
both are specified. [5]
* Use PRE-INSTALL target for SUB_FILES and SUB_LIST. [6]
* Introduce bsd.gstreamer.mk and utilize new macros:
USE_GSTREAMER/WANT_GSTREAMER. [7]
PR: ports/77634 [1], ports/77592 [2], ports/77385 [3],
ports/77557 [4], ports/77344 [5], ports/77211 [6],
ports/77838 [7]
Submitted by: krion [1] [2], Florent Thoumie <flz@xbsd.org> [3] [6],
pav [4], lofi [5], ahze [7]
|
|
|
|
|
|
|
|
|
| |
look for processes holding open references within the FS and kill
them, then use regular umount. This is necessary now that devfs
cannot be force-unmounted, and has the benefit that processes can't
hang around holding references to files between port builds.
* Preliminary work to support using ccache to accelerate builds.
|
|
|
|
| |
(i.e. it is not mounted by nfs)
|
|
|
|
|
|
|
| |
processes holding open references within the FS and kill them, then use
regular umount. This is necessary now that devfs cannot be force-unmounted,
and has the benefit that processes can't hang around holding references to
files between port builds.
|
|
|
|
|
|
|
|
|
|
|
| |
look for processes holding open references within the FS and kill
them, then use regular umount. This is necessary now that devfs
cannot be force-unmounted, and has the benefit that processes can't
hang around holding references to files between port builds.
* Reduce possibility for error by testing for presence of executable
ldconfig inside the chroot before attempting to run it (e.g. it may not
be there if the chroot was not completely initialized)
|
|
|
|
| |
false positives.
|
| |
|
|
|
|
| |
send nag-mails to the responsible maintainers.
|
|
|
|
|
|
| |
which are copied to www.freebsd.org for use by 'make fetchindex', as well
as the source of build failure reports on ports@FreeBSD.org when it is
broken.
|
| |
|
|
|
|
|
|
| |
This should probably be changed to only update it if it changes.
Approved by: portmgr (self)
|
|
|
|
|
|
| |
want to use the default value in the build chroot.
Approved by: portmgr (self)
|
|
|
|
|
|
|
| |
if the machine is behind a NAT and is not directly addressable, we can
use a localhost port forward to contact it)
Approved by: portmgr (self)
|
|
|
|
|
|
|
|
| |
value of variables
* Allow krion to drink from the email firehose
Approved by: portmgr (self)
|
|
|
|
|
|
|
|
| |
* Correctly calculate job concurrency in pass two as well
* In pass two run dosetupnode -rsync to avoid wasting time.
Approved by: portmgr (self)
|
|
|
|
|
|
| |
XXX This should be a portbuild.conf tunable
Approved by: portmgr (self)
|
|
|
|
|
|
|
|
| |
fetch from ftp-master and pointyhat; they'll just get timeouts.
Instead, each machine is expected to set up their own MASTER_SITE_*
variables in etc/make.conf via a bindist-${hostname}.tar file.
Approved by: portmgr (self)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
on a disconnected client, without running the time-consuming rsyncs.
This is useful when a build is interrupted and needs to be restarted.
* After we have cleaned up the machine, reset the queue counter by using
pollmachine -queue. This has a race condition if other builds are being
dispatched to the machine (e.g. builds on another branch):
getmachine can claim a directory and increment the counter, then the
machine is polled and finds e.g. 0 chroots in use, and resets the
counter to 0, then claim-chroot is run and the build dispatched, with
the counter now off-by-one. This could be fixed by running
claim-chroot with the .lock held, but this turns out to be too
time-consuming. A two-level lock approach might also fix this
efficiently.
|
|
|
|
|
|
|
|
|
|
| |
same time, assuming that the admin has already built the INDEX and
INDEX.old in advance.
* Adapt to new method of calculating build concurrency, by summing the
value of ${maxjobs} listed in every portbuild.${machine}
* Support 5-exp builds
|
|
|
|
|
|
|
|
|
|
|
| |
(i.e. if the package lists a dependency on the relevant package in the
PACKAGE_BUILDING case). This allows packages that require an
available DISPLAY to again build (with some forthcoming fixes to
existing ports).
Improve the reporting of detected filesystem anomalies (extra files
left behind after deinstallation, changes to and removal of
pre-existing files)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
synchronously instead of probabilistically scheduling jobs, which
means that the job load on a machine never exceeds a desired
threshold, and we can preferentially use faster machines when they are
available. This has a dramatic effect on package build throughput,
although I don't yet have precise measurements of the performance
improvements.
Specifically, the changes are:
* Introduce the new variable maxjobs in portbuild. This replaces the
build scheduling weights previously listed in the mlist file, which
now changes format to list the build machines only, ranked in order of
preference for job dispatches (i.e. faster machines first).
* The ${arch}/queue directory is used to list machines available for
jobs (file content is the number of jobs currently running on the
machine). Changes to files in this directory are serialized using
lockf on the .lock file.
* Claim a machine with the getmachine script, with the .lock held.
This picks the machine with the fewestnumber of jobs running, which is
listed highest in the mlist file in case of multiple machines with
equal load. The job counter is incremented, and the file removed if
the counter reaches ${maxjobs} for that machine. If all machines are
busy, sleep for 15 seconds and retry.
* After we have claimed a machine, we run claim-chroot on it to claim
an empty chroot, as before. If the claim fails, release the job from
the queue with the releasemachine script and retry after a 15 second
wait.
* When the build is finished, decrement the job counter with the
releasemachine script, with .lock held.
* The checkmachines script now exists only to poll the load averages
for admin convenience (every 2 minutes), and to ping for unreachable
machines. When a machine cannot be reached, remove the entry in the
queue directory to stop further job dispatches to it. This needs more
work to deal with reinitialization of machines after they become
available again.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
synchronously instead of probabilistically scheduling jobs, which
means that the job load on a machine never exceeds a desired
threshold, and we can preferentially use faster machines when they are
available. This has a dramatic effect on package build throughput,
although I don't yet have precise measurements of the performance
improvements.
Specifically, the changes are:
* Introduce the new variable maxjobs in portbuild. This replaces the
build scheduling weights previously listed in the mlist file, which
now changes format to list the build machines only, ranked in order of
preference for job dispatches (i.e. faster machines first).
* The ${arch}/queue directory is used to list machines available for
jobs (file content is the number of jobs currently running on the
machine). Changes to files in this directory are serialized using
lockf on the .lock file.
* Claim a machine with the getmachine script, with the .lock held.
This picks the machine with the fewestnumber of jobs running, which is
listed highest in the mlist file in case of multiple machines with
equal load. The job counter is incremented, and the file removed if
the counter reaches ${maxjobs} for that machine. If all machines are
busy, sleep for 15 seconds and retry.
* After we have claimed a machine, we run claim-chroot on it to claim
an empty chroot, as before. If the claim fails, release the job from
the queue with the releasemachine script and retry after a 15 second
wait.
* When the build is finished, decrement the job counter with the
releasemachine script, with .lock held.
* The checkmachines script now exists only to poll the load averages
for admin convenience (every 2 minutes), and to ping for unreachable
machines. When a machine cannot be reached, remove the entry in the
queue directory to stop further job dispatches to it. This needs more
work to deal with reinitialization of machines after they become
available again.
Additional changes to this file:
* Exit if passed a null package name, to avoid badness later on
* Send a nag-mail if pkg-plist errors are detected in the build
|
|
|
|
| |
* Other minor changes
|
|
|
|
|
|
|
|
|
| |
/rescue/mount -t linprocfs, so assume that the i386 build hosts have
statically-built copies of the necessary binaries in /sbin, until this is
fixed.
Create /usr/X11R6 inside the chroot so that mtree has something to do, since
this directory is otherwise orphaned.
|
| |
|
| |
|
|
|
|
| |
the BSD.x11.dist if set to xfree86-3, otherwise use BSD.x11-4.dist.
|
|
|
|
| |
on pointyhat.
|
|
|
|
|
| |
Submitted by: linimon
Reminded by: marcus
|
|
|
|
|
| |
of needing to also include the dynamic libraries that were confusing
some ports. We still need libc.so.[56] for killall to work, though :(
|
| |
|
|
|
|
| |
a port that should not be listed here
|
|
|
|
| |
the client to the client_user so they can later write to them
|
|
|
|
| |
to use.
|
|
|
|
|
|
|
| |
List the extra/removed/changed files separately, and colour-code the
serious errors (files left behind outside of /usr/local and /usr/X11R^;
files removed that were installed by another port, and files with changed
permissions or ownership)
|
|
|
|
|
|
|
| |
the port deinstall; mtree does not recurse into subdirectories it does
not know about
* Break out the 'files incorrectly removed' and 'files incorrectly changed'
into their own sections
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
* Remove USE_QT2 since it's obsolete now. [2]
* Clarify comments about ARCH. [3]
* Speedup 'make readmes'. Add a perl script "Tools/make_readmes"
and modify bsd.port.subdir.mk to avoid recursing into individual
port directories to create README.html. [4]
* Fix 'make search' to allow case insensitive search on 5-x/6-x. [5]
* Add the possibility to search the ports by category. [6]
* Remove tk42 and tcl76 from virtual categories since they're
obsolete. [7]
* Introduce new variable - DISTVERSION, vendor version of the
distribution, that can be set instead of PORTVERSION and is
automatically converted in a conforming PORTVERSION. [8]
* Use --suffix instead of -b option for patch(1) to make it
compatible with BSD patch(1) [9]
* Fix {WANT,WITH}_MYSQL_VER behavior, to deal with conflicting
versions. [10]
PR: ports/68895 [1], ports/69486 [2], ports/68539 [3],
ports/70018 [4], ports/68896 [5], ports/73299 [6],
ports/73570 [7], ports/67171 [8], ports/72182 [9]
Submitted by: linimon [1][3], arved [2][7], cperciva [4],
Matthew Seaman <m.seaman@infracaninophile.co.uk> [5],
Radek Kozlowski <radek@raadradd.com> [6],
eik [8], Andreas Hauser <andy-freebsd@splashground.de> [9],
clement [10]
|
|
|
|
| |
Approved by: will
|
|
|
|
|
| |
flatten the setupnode() function into the main body since it's only
called from one place.
|
|
|
|
|
|
|
|
|
|
| |
restricted ports' instead of 'don't build any restricted ports' since
the former is useful when we're not intending to publish the results
of a build, but the latter is not.
Move the build preprocessing (directory setup, old build rotation,
etc) out from under -nobuild, so that we can set up a new build using
that option.
|
|
|
|
|
| |
error log for the port, instead of assuming it exists in the current
build.
|
| |
|
|
|
|
| |
Remove useless sleep(1).
|
| |
|
|
|
|
|
|
|
| |
${arch}/${branch}/latest/${portdir}. We will use this in the
processfail script, so that the "new package build errors" webpages do
not have out-of-date links but instead link to the most recent copy of
the build error.
|
|
|
|
| |
don't generate extra hunk each time patchfile is updated.
|
|
|
|
|
|
|
| |
machines where we first connect to a non-root user and then increase
privileges.
Approved by: portmgr (self)
|
|
|
|
|
|
|
|
| |
manually
* Support 6.x builds
Approved by: portmgr (self)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
that it may be called by hand.
Support new portbuild.conf variables
client_user = user to connect to on the client (not necessarily
root). This user must have write permission to the
/var/portbuild tree if disconnected=1 (i.e. we're
going to run rsync).
rsync_gzip = set to "-z" to enable compression on low-bandwidth
disconnected clients.
Approved by: portmgr (self)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
ssh times out)
* Support new portbuild.conf settings:
client_user = user to connect to on the client (not necessarily root)
sudo_cmd = If ssh'ing to a non-root user, run this command to gain
root privs (set to empty string for client_user=root,
or sudo for !root). Cannot require interactivity, of
course.
Approved by: portmgr (self)
|
|
|
|
|
|
| |
the wrong path
Approved by: portmgr (self)
|
|
|
|
| |
Approved by: portmgr (self)
|
|
|
|
| |
Approved by: portmgr (self)
|
|
|
|
|
|
|
| |
* Default 4.x to XFree86 4.x, 5.x and above to x.org
* Don't pick up local customizations from OPTIONS
Approved by: portmgr (self)
|
| |
|
| |
|
|
|
|
| |
directories likely to contain changed files).
|
|
|
|
|
| |
was not atomic and could have ended up with two port builds trying to use
the same chroot. Report the claimed directory back to the caller.
|
|
|
|
| |
>48 hours, to cope with monster ports like openoffice and atlas.
|
|
|
|
|
|
|
| |
because this file is a chronological history of port builds that have
failed, the files listed may not be present in the current set of
error logs, and we currently have no easy way to find the most recent
failure log to use instead.
|
|
|
|
|
|
|
|
| |
i386-5-latest that are linked to from the index.html are symlinks to
dated directories (e.5.`date`), so the URLs in the error reports will
expire with the start of the next build when the symlink is repointed.
This change makes the URLs in the error reports use the realpath of
the target file, so they do not expire.
|