aboutsummaryrefslogtreecommitdiffstats
path: root/Tools
Commit message (Collapse)AuthorAgeFilesLines
* Add an overly-large regexp to isolate "packages that fail to build withlinimon2011-02-271-0/+3
| | | | | | | clang". This will probably need to be trimmed down some so as to not pessimize processing time. At this time this change will be restricted to pointyhat-west.
* One more pass through this file to bring it up to the latest processonelog:linimon2011-02-271-53/+70
| | | | | | | | | | - deprecate assert, chown, perl5, python, stdio, sysvipc, varargs - add the existing nested_declaration, termios, utmp_x While here, fix formatting. Pointy hat to: linimon, for letting this get so far out of sync
* For efficiency's sake, deprecate the following error types, which we no ↵linimon2011-02-271-34/+13
| | | | | | | | | | | | longer see: chown, perl5, python, stdio, struct changes, sysvipc, USE_XLIB, varargs Add the following new error types that we are now seeing: clang-bug, cpusetsize, sem_wait Tweak the definitions for linker_error and threads to be more accurate.
* Sheesh. The errors "f77" and "uname" were never even documented. Addlinimon2011-02-271-0/+11
| | | | the into the section for obsolete errors.
* Move some of the error types that were removed from the script some timelinimon2011-02-271-26/+26
| | | | ago to the "obsolete" section.
* Add the following new error classifications, to sync with upcoming worklinimon2011-02-251-4/+30
| | | | | | | | | | | | | to processonelog (not yet committed): clang clang-bug cpusetsize sem_wait The former two will show up if an -exp run is done with clang as the default ports compiler, instead of gcc. The latter two seem to be ports regressions in 9-CURRENT.
* Remove 6.x links since it is EOL. (For now, the error logs remain).linimon2011-02-221-66/+13
| | | | | While here, change the misnomer Full to Previous, but leave the links alone until we upgrade pointyhat to the latest codebase.
* Make table headers more selfexplanatoryerwin2011-02-061-1/+1
| | | | | Submitted by: gerald Feature safe: yes
* 7.1 runs EOL today, start building against 7.3erwin2011-01-311-1/+1
| | | | Feature safe: yes
* Change the "unclean build" handling case to not retry. Previously, itlinimon2011-01-261-1/+1
| | | | | | | | | | | was handled the same as "waiting for chroot" and retried. In certain circumstances (e.g. a prerequisite package shown as being avaialable when it really wasn't), this would cause a package build to loop forever. Note to future generations: I did not write this code. Feature safe: yes
* Fix typo in fixed-up tar command to suppress a whoooole lot of junklinimon2011-01-241-1/+1
| | | | | | | output on package builds. Pointy hat: self Feature safe: yes
* Add an entry for the 'dirent' error.linimon2011-01-241-0/+6
| | | | | Noticed by: Anton Shterenlikht Feature safe: yes
* Add anti-foot-shooting measure.linimon2011-01-231-1/+1
| | | | Feature safe: yes
* Export BACKUP_FTP_SITE for the generalized make.conf files inlinimon2011-01-231-0/+3
| | | | | | | bindist-*.tar (so that they can be shared between pointyhat and pointyhat-west without modification.) Feature safe: yes
* Add CLIENT_BACKUP_FTP_SITE as part of a generalization push betweenlinimon2011-01-231-0/+3
| | | | | | bindist-*.tar files on pointyhat and pointyhat-west. Feature safe: yes
* Force the copy of portbuild.* files as files, not symlinks. Adjustlinimon2011-01-231-2/+5
| | | | | | the comment for bindist-* to match. Feature safe: yes
* Revert to RELENG_7_1 after consultation with re@erwin2011-01-181-1/+1
| | | | | Feature safe: yes (this time for real) Approved by: portmgr,re
* Bump 7-stable to RELENG_7_4 due to a major library version increaseerwin2011-01-151-1/+1
| | | | | | in libcrypto. Feature safe: yes (really, really not, but we don't have any other option)
* rmdir(1) does not take -f.erwin2011-01-061-1/+1
|
* Drop support for 6.x and bump 8.x to 8.1-RELEASEerwin2010-12-211-3/+2
|
* Remove debugging code that crept in.linimon2010-12-171-1/+1
|
* Refactor the client-side. It turns out that the evaluation of param.hlinimon2010-12-161-20/+21
| | | | | | | | | was being done before the src tree had been mounted. This was not a problem in the old codebase, since it simply got the wrong src tree to start with. This actually simplifies the code.
* If the logfile was not correctly copied from the client back to the server,linimon2010-12-161-10/+15
| | | | do not attempt to process it.
* Make sure that PKGSUFFIX and LOCALBASE are really defined. (Things worklinimon2010-12-161-6/+8
| | | | | | | _very_ badly if they aren't.) Also, track the refactoring of buildenv so that the proper src tree bits are picked up.
* Drop support for FreeBSD 6.x.erwin2010-12-141-7/+2
|
* common.conf has to be copied over as well as client.conf.linimon2010-12-091-4/+4
|
* Refactor some variables that need to be in sync between the server-sidelinimon2010-12-012-6/+3
| | | | | | | and client-side definitions into common.conf. While here, slide the 7-stable release to 7.3. This was driving me crazy while trying to debug the INDEX and duds problems.
* It turns out that some variables have to be shared between the server-sidelinimon2010-12-011-0/+21
| | | | | | | | definitions and the client-side definitions. While here, add ARCHS_SUPPORTING_COMPAT_IA32, which is needed to get linux emulation ports to be properly detected on head nodes that are build from first principles (e.g. !pointyhat).
* Canonicalize the use of SRC_BASE to fix INDEX and duds builds on headlinimon2010-12-011-24/+38
| | | | | | | | | | | | nodes that don't have /usr/src. On pointyhat, this "just happens to work"; on a cleanly installed system like pointyhat-west, it didn't. Add overrides for Linux compatibility (again, it "just happened to work" on pointyhat). Move the code that sets PORTSDIR and SRC_BASE to the server side only. The code that overrides OSVERSION, OSREL, and BRANCH _must_ remain in the common code.
* Canonicalize the use of SRC_BASE to fix INDEX and duds builds on headlinimon2010-12-013-9/+16
| | | | | nodes that don't have /usr/src. On pointyhat, this "just happens to work"; on a cleanly installed system like pointyhat-west, it didn't.
* Make an rm command quieter; add some debug comments.linimon2010-12-011-1/+3
|
* Although I was going to try to avoid it, it turns out that it islinimon2010-12-019-0/+9
| | | | | | impossble to have merely "server.conf" and "client.conf" control everything on a head node. Some pieces must be refactored into "common.conf".
* Rename internal variables to correspond to their actual uses; automaticallylinimon2010-12-011-4/+23
| | | | create the links for the webserver; add some comments.
* Add some debug code to attempt to work around the "too many stale chroots"linimon2010-12-011-0/+7
| | | | problem, until it can be correctly understood and fixed.
* Add a debug setting (commented out).linimon2010-11-291-0/+3
|
* Move the override of PKG_DBDIR to the right place. This keeps INDEXlinimon2010-11-291-3/+3
| | | | from being contaminated by the packages installed on pointyhat-*.
* - Switch to SHA256 checksumspav2010-11-181-11/+11
| | | | | PR: ports/152358 Submitted by: Volodymyr Kostyrko <c.kworr@gmail.com>
* Retire the broken fenner distfile survey in favor of the new onelinimon2010-10-071-6/+2
| | | | being maintained by ehaupt.
* Attempt to shut down some whining when the resultant script is run.linimon2010-10-071-1/+1
|
* - s/make/may/pgollucci2010-09-241-1/+1
| | | | Reported by: wxs
* -use a tab not a spacepgollucci2010-09-231-1/+1
|
* /8/9/ as the defaultpgollucci2010-09-231-1/+1
|
* blanket approvalpgollucci2010-09-231-0/+1
|
* check for repocopy snafuspgollucci2010-09-141-0/+43
|
* Fix it for real this time.linimon2010-08-171-7/+13
|
* Restore the display of statistics for non-mainline runs.linimon2010-08-161-1/+1
|
* Add some missing error handling.linimon2010-08-161-0/+4
|
* Handle yet another error case.linimon2010-08-151-0/+3
|
* Correct some misleading documentation.linimon2010-08-101-3/+3
|
* Fix braino from production.linimon2010-08-022-2/+2
|
* Fix mishandling of root/all case.linimon2010-07-302-12/+10
|
* Push PACKAGE_BUILDING and MALLOC_OPTIONS up a level.linimon2010-06-301-4/+2
| | | | Feature safe: yes
* Remove now-redundant setting of PACKAGE_BUILDING.linimon2010-06-302-2/+0
| | | | Feature safe: yes
* Fix up usage of buildenv.client to deal with overenthusiasticlinimon2010-06-301-3/+5
| | | | | | | refactoring. Pick up new CLIENT_MALLOC_OPTIONS parameter. Clean up comments. Feature safe: yes
* Add CLIENT_MALLOC_OPTIONS.linimon2010-06-301-0/+3
| | | | Feature safe: yes
* The previous refactoring was too agressive. SRCBASE and friends are usedlinimon2010-06-301-15/+20
| | | | | | | on both the client side and server side. Pointy hat to: self Feature safe: yes
* Correct the URLs; 'http://' is not included in MASTER_URL.linimon2010-06-281-7/+7
| | | | Feature safe: yes
* Document some hard-coded stuff in the scripts.linimon2010-06-261-0/+22
| | | | Feature safe: yes
* A script that can be remotely run on package build clients to attempt tolinimon2010-06-261-0/+10
| | | | | | clean up problems with squid. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-262-4/+8
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. NOTE: these scripts are not yet parameterized, so this is WIP. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-262-62/+37
| | | | | | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Several bugs are fixed and improvements are made: - parameterize everything. - switch to csup. (This necessitates pushing the repos down one directory level, e.g. ports-head/ports and src/src-8. However, this will give us the flexibility to have e.g. src/src-8.1 in the future.) - note that the misnomer filename 'cvsdone', which was created here, is now changed to '.updated'. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-3/+5
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. While here, do some refactoring. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-2/+2
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Note the change of the misnomer filename 'cvsdone' to '.updated'. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-19/+22
| | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Several bugs are fixed and improvements are made: - suppress error message if there are no logs yet. - change the misnomer filename 'cvsdone' to '.updated'. - fix a bug by un-escaping '_' in the timestamp. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-3/+8
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. While here, fix error messages displayed on new runs. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-29/+46
| | | | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. *very* carefully note where the exported variables are consumed. Several bugs are fixed and improvements are made: - the file UNAME_VERSION appears unused, so it is removed. The information is passed in overrides to uname(1). - parameterize arch-specific setup code. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-9/+11
| | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-4/+16
| | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Note the removal of the hard-coding of INDEX.N, where N has to be a single digit, and also have no '.' in it. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-21/+6
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Note the very special handling of cvs tag. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-2/+3
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Fix the sed script to correctly handle '.' in branch directory names. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-0/+5
| | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Gracefully handle the case of INDEX failing to build. This helps the calling script to exit instead of spewing errors. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-1/+10
| | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Add the copying over of client.conf to the clients, and take care to force the file copy regardless of whether it is a symlink. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-45/+51
| | | | | | | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Several bugs are fixed and improvements are made: - the name of the journal is changed from 'make' (ew) to 'journal'. - 'cvsdate' is replaced by the more accurate name '.updated' and documentation adjusted to match. - make it more clear that '.updated' means 'ports tree updated' instead of 'src tree updated' (although the same filename is used for both). - correctly handle the general case of non-mainstream branches (e.g. "7-exp") without hardcoding "-exp". Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-15/+30
| | | | | | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Note: the major change is to require branch as an argument. The silly code that expected the branch to be passed via a symlinked command such as 'dopackages.7' is removed. Several bugs are fixed and improvements are made: - make the separation of 'date' and 'datestamp' clearer. - make handling of error conditions (e.g. for a first-time run where 'build create' has been forgotten) more obvious. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-46/+82
| | | | | | | | | | | | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Several bugs are fixed and improvements are made: - the name of the journal file is changed from 'make' (ew) to 'journal'. - the 'date' parameter becomes 'datestamp' to delinate the script's uses of the date command vs. the parameter. This is mostly for readability. - add the -nochecksubdirs option. This is only useful for restarted or incremental runs. - refactor the error returns a bit. - exit gracefully if no INDEXFILE. - fix a bug in the 'packages built' logic that would return -2 if no packages were actually built. - change the misnamed 'cvsdone' file to '.updated'. - clean up the 'task waiting' logic. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-0/+3
| | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Note that this script will now figure out 'branches' by itself, thus removing the special-casing for '-exp'. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-1/+6
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Note: it is still not clear to me if this script is currently used. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-11/+17
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. While here, rework the code a bit to parameterize arch-specific tasks. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-9/+15
| | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. While here, carefully document the origin of the values of the environment variables that are passed in. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-262-10/+22
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. While here, do some cleanup. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-76/+80
| | | | | | | | | | | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Several bugs are fixed and improvements are made: - the definitions for valid 'arch' and 'branch' are moved to server.conf. - the script is broken up into two pieces; the old 'buildenv' name becomes the server side, and 'buildenv.client' is add for the client side. 'buildenv.common' is what you would expect. This makes the separation of what controls what more clear. - the concept of 'branch base' is generalized to match any pattern postpended with '-', thus removing the specialness of '-exp'. More work remains on the other scripts to best take advantage of this. - as a corollary, 'branch' can also have '.' in it, e.g., 6.4. - the obsolete variables FTP_PASSIVE_MODE, PKGZIPCMD, and X_WINDOW_SYSTEM are removed. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-261-31/+34
| | | | | | | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. Several bugs are fixed and improvements are made: - archive directories are created if they do not exist. - the location of ZFS-based directories is generalized. - the special string "-exp" disappears. - handling of buildid is made more robust. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-262-7/+13
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. While here, fix a but in the handling of the 'all' case. Feature safe: yes
* Generalize the packge building scripts to be able to be run on more thanlinimon2010-06-2611-12/+34
| | | | | | | | | | | | | one 'head' node, rather than just pointyhat itself. Constants are factored out into installation-specific files known as portbuild/conf/server.conf and portbuild/conf/client.conf. There is only one server.conf file. Individual <arch> directories may have their own client.conf files, or may symlink to ../conf/client.conf. This first set of files only gets the *.conf files and some cleanup. Feature safe: yes
* Variant of the allgohans script that does locking. This has been inlinimon2010-06-261-0/+58
| | | | | | use on pointyhat for a while. Feature safe: yes
* Note the files that shouldn't be checked into the repository (theylinimon2010-06-261-0/+3
| | | | | | may contain private information). Feature safe: yes
* Remove obsolete cruft that has not been used in several years.linimon2010-06-237-256/+0
| | | | Feature safe: yes
* A new file to document some generalization of scripts on a packagelinimon2010-06-231-0/+32
| | | | | | | | | building server. For security reasons, the scripts themselves will not be checked in to this repository. Please do not commit to this file without the approval of portmgr. Feature safe: yes
* Some configuration information that is shipped to the clients of alinimon2010-06-231-0/+16
| | | | | | | | package building cluster. Please do not commit to this file without the approval of portmgr. Feature safe: yes
* A new file to centralize definitions that apply to the the package nodeslinimon2010-06-231-0/+40
| | | | | | | | | used from a package building cluster. This is part of a rewrite to remove a great deal of hardcoding. Please do not commit to this file without the approval of portmgr. Feature safe: yes
* A new file to centralize definitions that apply to the server-side oflinimon2010-06-231-0/+97
| | | | | | | | | a package building cluster. This is part of a rewrite to remove a great deal of hardcoding. Please do not commit to this file without the approval of portmgr. Feature safe: yes
* Catch up with master copy on pointyhat.linimon2010-06-223-14/+40
| | | | | | | Note: all 3 of these files will be changing radically in the near future. This is the last checkin from the "classic" codebase installation. Feature safe: yes
* These appear to no longer be used.linimon2010-06-222-104/+0
| | | | Feature safe: yes
* - Unbreak the -n flag;romain2010-06-061-6/+5
| | | | | | - Remove invalid reference to freefall. Approved by: garga
* Restore line dropped in revision 1.21.linimon2010-06-031-0/+1
| | | | Pointyhat to: linimon
* Sigh. This had already been done, just not checked out on production.linimon2010-06-016-7/+1
| | | | Pointy hat: self
* Get rid of the remnants of X11BASE.linimon2010-06-016-1/+7
|
* Remove some hardcoding.linimon2010-06-011-5/+5
|
* Add a comment.linimon2010-06-011-0/+2
|
* Eliminate some more hardcoding. Expand the pattern for "non-mainstream"linimon2010-05-261-5/+9
| | | | builds to also catch \., not just \-.
* Remove the hard-coding of '-exp'. While here, factor out some otherlinimon2010-05-251-6/+9
| | | | hardcoding to defines.
* Remove obsolete cruft.linimon2010-05-231-8/+0
|
* Cronjob that runs on pointyhat to cleanup stale chroots on clients.linimon2010-05-221-0/+11
|
* Trim backup files a bit; make the emails a bit more verbose.linimon2010-05-202-12/+24
|
* Refactor things a bit.linimon2010-05-201-4/+5
|
* Improve error handling a bit.linimon2010-05-202-1/+6
|
* Revert the clang part of rev 1.12, which is now default in clangbsd.erwin2010-05-101-6/+0
|
* Add a case to detect a transient problem that shows up on all packagelinimon2010-03-311-0/+3
| | | | | | | | | | | | | | nodes, but most regularly on sparc64. (Occasionally, on amd64 and ia64). For reasons I haven't been quite able to track down, on some occasions a pkg_add command is unable to extract a dependency; the tarfile shows up as being truncated. This does not seem to be due to disk-low or memory-low conditions, nor is it a problem with scp; the md5 on the file is fine when examined afterwards. The only clue so far is that it seems to happen on systems with the most package builds running simultaneously -- and thus, possibly more than one pkg_add running in parallel.
* Add an entry for the "truncated distfiles" problem; improve one other entry.linimon2010-03-311-1/+7
|
* - allow addport to work in ports-mgnt againdinoex2010-03-251-1/+1
| | | | Approved by: garga, drso, flz
* Catch up with production.linimon2010-02-201-0/+14
| | | | Feature safe: yes
* Bring this up to date with what is in production: add 'queue length'linimon2010-02-201-3/+20
| | | | | | column from pav; fix first-column formatting. Feature safe: yes
* Bah, another few references to "8-current", which no longer exists.linimon2010-02-061-12/+12
|
* - Add a script to check unneeded dependencies for perl modules.kuriyama2010-01-292-0/+107
|
* Add some new error cases to handle regressions in -current. (Not yetlinimon2010-01-201-0/+14
| | | | | | | | | | | | | | analyzed for how much they will slow this script down; consider this a rush-job.) - dirent denotes some change in the usage of dirent.h. - termios denotes the deprecation of <sys/termios.h>. - uname denotes the hiding of the uname symbol. This has been backed out in src so let's hope this case can go away soon. - utmp_x denotes the replacement of utmp.h with utmpx.h. Together these catch ~150 new errors on i386-9. However, there are more that are not caught (second-order effects.)
* Note that we are at 9-CURRENT now. Also, ia64 builds have resumed.linimon2009-12-191-1/+19
|
* - Remove use of X11BASE from pointyhat scriptspav2009-12-188-16/+9
|
* Correct depreciation warning with Python 2.6 and fix several warningssobomax2009-11-211-19/+19
| | | | from the pytchecker.
* A few more loose ends.linimon2009-11-191-2/+2
| | | | Testing by: miwi
* Make the create command more robust by making even more directorieslinimon2009-11-191-20/+27
| | | | and checking more error results.
* Properly supppress empty buildenvs.linimon2009-11-171-36/+36
|
* Refactor this to minimize hard-coding. When our support for brancheslinimon2009-11-161-23/+15
| | | | changes, now you only need to change 2 lines.
* Harden these a bit: make them identify on which host they were running;linimon2009-11-162-7/+9
| | | | skip unncessary steps.
* Fix up the problems that can happen when 2 copies of makeworld arelinimon2009-11-132-10/+12
| | | | running simultaneously for separate buildenvs.
* Make more robust.linimon2009-11-131-1/+4
|
* Parameterize.linimon2009-11-131-7/+13
|
* Harden this script so it will DTRT if any subdirectories of a new build,linimon2009-11-101-12/+45
| | | | | or pieces of a pre-existing build, are missing. These are both the case when dopackages follows 'build create'.
* Remove a trailing slash on a directory name, that merely gets doubledlinimon2009-11-101-1/+1
| | | | later in the code.
* Finally fix the 'build create' command to DTRT by reusing some already-linimon2009-11-101-38/+32
| | | | working code. While here, clean up a bit.
* Reflect the fact that src-HEAD is now just a symlink to src-9. Thislinimon2009-11-101-1/+1
| | | | | dance-step prevents having to introduce some special-case code into the build script.
* Fix permissions and 'latest' link.linimon2009-11-091-3/+14
|
* Remove a doubled slash.linimon2009-11-091-2/+2
|
* Implement the "build create" command.linimon2009-11-091-5/+36
|
* Remove cruft.linimon2009-11-081-3/+0
|
* Allow for the possibility of powerpc builds. Since these are not yetlinimon2009-11-082-4/+16
| | | | set up, add error handling to gracefully handle missing directories.
* Allow for the possibility of powerpc builds.linimon2009-11-081-1/+1
|
* Remove dead code.linimon2009-11-081-9/+1
|
* Reflect reality on pointyhat. While here, clean up a bit.linimon2009-11-081-2/+3
|
* - Fixed "permission denied" errorglarkin2009-10-061-2/+2
| | | | | | - Prevented full ports tree build when operating with ~/.cvsrc PR: ports/139121
* Correctly bump PORTREVISION?= instead of always resetting to 1 in this case.gerald2009-09-151-1/+1
| | | | | PR: 138774 Approved by: edwin
* Add links for 9-current. (note: 8-current is not 8-stable ... yet.)linimon2009-08-241-2/+69
| | | | While here, remove some staleness.
* Generalize this script to remove the necessity of editing it every timelinimon2009-08-241-13/+11
| | | | | we create a new src branch. While here, garbage collect some code that hasn't been run for years.
* I believe that this script is obsolete. Retire it.linimon2009-08-231-75/+0
|
* Add 9 and 9-exp to this sample file. Delete 6-exp2.linimon2009-08-231-1/+1
|
* Add support for RELENG_8erwin2009-08-231-0/+7
|
* Reflect RELENG_9.linimon2009-08-231-1/+1
|
* Add support for INDEX-9erwin2009-08-231-3/+8
|
* Reflect the fact that RELENG_9 has been created, and that there is somelinimon2009-08-234-4/+16
| | | | interest in reviving ia64. While here, generalize things a bit.
* Turn off the 'show latest log' feature. While handy, this thrashes thelinimon2009-08-231-21/+27
| | | | | | | disks. While here, note that there is some interest in reviving ia64 package builds.
* Add a timeout to the qmanager connection.erwin2009-08-131-0/+1
|
* Make sure that some options to dopackages are passed to the environmenterwin2009-08-131-7/+11
| | | | when invoking pdispatch.
* Also put bzipped and checksums of INDEX, UPDATING and MOVED on the mirrorserwin2009-08-121-0/+5
| | | | | PR: 131440 Requested by: Hannes Hauswedell <freebsd@soulrebel.in-berlin.de>
* - Upload MOVED and UPDATING to the packages directory to make iterwin2009-08-111-10/+10
| | | | | | | | available on the ftp mirrors alongside the packages [1] - While I'm here, remove a NOOP check for FreeBSD 4.x -exp PR: 135024 [1] Requested by: Dominic Fandrey <kamikaze@bsdforen.de>
* 5 and 5-exp are no longer supported.linimon2009-07-201-1/+1
|
* Explicitly override LOCALBASE to make sure we don't geterwin2009-07-142-0/+2
| | | | | | | confused by locally installed ports that might influence PKGNAME or other variables. Suggested by: pav
* - Seems magic slash stopped working on -CURRENT zfs, so do without itpav2009-07-081-1/+1
|
* Force cleaning of the environment from customized local settings.erwin2009-06-061-0/+5
|
* Switch the 'skipped' column to point to duds.verbose instead of duds,linimon2009-06-031-1/+1
| | | | now that it is available in all current builds.
* Use zfs snapshots that are periodically updated on pointyhat for theerwin2009-05-281-27/+78
| | | | | normal builds instead of a local cvs update. This speeds up the script several times and easies I/O on pointyhat.
* - Update to reflect a reality on pointyhatpav2009-05-2217-716/+989
|
* - Separate ports tree updating to use cvsup from cvsup-master instead of cvspav2009-05-222-6/+56
| | | | update from NFS mount, which is just way too slow
* note mark_safe.plpgollucci2009-05-171-0/+1
|
* o don't set anything in ports with NO_BUILDpgollucci2009-05-171-3/+3
| | | | | o fix rubygem skipping o next, not die
* Do not mark rubygem ports, its a NO-OPpgollucci2009-05-161-0/+2
| | | | Discussed with: pav on irc (#bsdports)
* Make previous commit work for both context and unified input patches.itetcu2009-05-111-1/+1
|
* When naming the split patch files, replace the original path '/' with '__'itetcu2009-05-111-1/+1
| | | | instead of a single '_' to follow the current patch naming guidelines.
* - fix --port supportpgollucci2009-04-301-1/+3
| | | | - don't change the Makefile if MAKE_JOBS_(UN)SAFE is already present
* - Start some docspgollucci2009-04-301-11/+93
| | | | - Add --ports -p to specify a list on the cli
* Script to set MAKE_JOBS_(UN)SAFE= yes for a MAINTAINERs ports.pgollucci2009-04-221-0/+191
| | | | | | | Please be sure to completely test the results of running this _BEFORE_ committing several times and in a Tinderbox Feel free to commit to this file
* Fix bug where number of error logs was incorrect.linimon2009-03-261-8/+9
|
* Rewrite of processlog by kris.linimon2009-03-261-84/+147
|
* - Add a new case 'nested-declaration' to catch errors on -current.linimon2009-03-251-2/+4
| | | | | - Fix false positives for 'cluster'. - Add 'error: invalid pure specifier' case to badc++.
* Use diff -p both when first creating and when updating a patch.naddy2009-02-161-1/+1
| | | | | Previously a patch created by update-patches would be changed again by the next update-patches run.
* Remove 6-exp2 builds, they haven't been used in a whilepav2009-01-222-6/+3
|
* Factor out the code that performs the PORTREVISION bump for one port.gerald2009-01-081-42/+47
| | | | Approved by: edwin
* Reduce per branch code duplicationerwin2008-12-281-41/+16
| | | | Submitted by: pgollucci
* Make sure we don't add ${WRKDIR}.sobomax2008-10-221-4/+4
|
* Handle the rest of the edge cases; drop 5 as obsolete; cleanup.linimon2008-09-181-23/+35
| | | | | | Now re-enabled on production. Approved by: portmgr (self)
* Bring this into the new portbuild world order. While here, try tolinimon2008-09-181-27/+94
| | | | | | suppress hrefs for non-existant files (incomplete). Approved by: portmgr (self)
* RELENG_5 is desupported.linimon2008-09-121-3/+3
| | | | Approved by: portmgr (self)
* Major overhaul:linimon2008-09-071-349/+172
| | | | | | | | | - bring this closer to the default FreeBSD page style - remove unsupported releases - remove the date stamps, which no longer work - remove obsolete commented-out junk Discussed on: portmgr, some time ago
* Add a new script for performing high-level administration of a build.kris2008-08-091-518/+496
| | | | | | | | | | | | | | | list : lists available builds clone : creates a new build by cloning a previous one portsupdate : update a ports tree to the latest ZFS snapshot srcupdate : update a src tree to the latest ZFS snapshot cleanup : clean up or remove a build on the clients destroy : remove a build on the server There is some trickiness here in that various commands either expect to run as root, or expect to run as a ports-* user. For the latter case we can easily use su to proxy as the ports user when running as root; for the former we use the buildproxy to validate and re-execute the command as root.
* Add an option to clean up old distfiles. We don't have enough space tokris2008-08-091-0/+10
| | | | keep dozens of full distfile sets lying around.
* Update the list of openoffice.org ports: remove 1.x and add 3.xerwin2008-07-301-1/+1
|
* Oops, commit the right version of this (adds extra checks that onlykris2008-07-261-0/+5
| | | | expected commands will be proxied)
* * Simple client that passes on a build request to the buildproxykris2008-07-261-0/+32
|
* * Python daemon run as root that proxies privileged build commands forkris2008-07-261-0/+75
| | | | | | | | the ports-* users. Currently it is not possible to delegate management of ZFS filesystems to non-root users, so root privilege is required to manipulate them. We validate the command passed on a local domain socket and re-execute the build script with the requested parameters.
* Script run from cron to regularly update the master ZFS copies of thekris2008-07-261-0/+63
| | | | | | | | | | | | | | ports and source trees. Since we have >=1 consumer of these trees that run frequently but do not insist on up-to-the-second trees, it makes sense to "pre-update" them regularly and then then re-use in all of the consumers, instead of potentially doing several updates simultaneously or on demand. Consumers can clone the ZFS snapshot into their local filesystem which takes a couple of seconds instead of minutes or tens of minutes for the CVS update. We update to a date stamp instead of "." because this avoids ambiguity of commits that happen while the tree update is in progress (unfortunately it's slower).
* Script run from cron on the package clients to report metrics to ganglia.kris2008-07-261-0/+35
| | | | | | | | Currently we collect: * The current and maximum number of vnodes in use * The number of packages built over the past hour
* Simple script to expire ZFS snapshots older than a certain agekris2008-07-261-0/+47
|
* Python script for backing up ZFS filesystems on pointyhat. For eachkris2008-07-261-0/+217
| | | | | | listed filesystem we take a new snapshot each time it is run and if the last full backup was not too long ago, do a compressed incremental backup from the previous backup.
* * Add comment that this is unusedkris2008-07-261-0/+1
|
* * Add commentskris2008-07-261-1/+6
|
* * Cleanupkris2008-07-261-28/+153
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Catch up to build ID directory changes * Support a meta-hostname of 'all' for setting up all clients at once. This is better than the old way of running one copy of the script for each client by hand, since it is easier and involves less duplicated work. * We copy in the per-build ports, src, and bindist .tbz files and .md5 checksums, as well as refreshing the build scripts and bindist-$(hostname).tar customization tarball. * The -force switch forces copying of files and re-extraction of the tarballs on the client. This is necessary in order to propagate local changes to the tarballs after the initial client setup (e.g. if you need to change a file in the ports tree, it must be recompressed, redistributed, and re-extracted on the client). * The -queue switch will poll the client's job queue after completion of the setup. This is racy and should only be used when the machine is not currently accepting jobs. * For cleaning up a build the 'build cleanup' command should now be used instead. It calls back into this command but also allows full clenaup of build-local files on the client. TODO: "all" setups are hard on the server since they may spawn dozens of rsyncs at once. A better solution would be to have a worker pool of setup tasks to limit the maximum load.
* * Cleanupkris2008-07-261-28/+23
| | | | | | | | | | * Catch up to build ID directory changes * Make it easier to kill a build by not running dopackages in the background where it is detached from shell job control. Now, sending a termination signal to this process (e.g. ^C) will also kill off the dopackages script and in turn the processes created by it. Some background processes spawned by dopackages, pdispatch, etc, may still remain and need to be killed by hand.
* * Cleanupkris2008-07-261-496/+581
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Catch up to build ID directory changes * Improve usage() * Fix a variety of small bugs * Remove support for -ftp builds: we have not supported direct uploading for many years due to the desire to manually inspect build output for quality * All data associated to a build is now localized in its own directory named according to a build ID: /var/portbuild/${arch}/${branch}/builds/${buildid}, where ${buildid} is the creation time. These are actually ZFS filesystems. * Tasks such as cloning a new build, updating a ZFS snapshot, and cleaning up a build are exported to the "build" script, which can be used independently. * Creating a new build is done by ZFS cloning and takes a couple of seconds since it is copy-on-write (i.e. no data needs to be copied). * Ports and source trees are also cloned from pre-updated ZFS images (updated regularly from the "updatesnap" cron job). In most cases we do not care if we are building a ports tree that is an hour or so old since it will become outdated almost immediately anyway, so no matter what we do there will be times when a port has been fixed by the time the build error is generated by a client. * In case an up-to-the-second tree is desired, the -portscvs and -srccvs switches update the existing ports tree via CVS. * -noports and -nosrc can be used to prevent any automatic changes to the ports tree. This is useful for dealing with local modifications (e.g. for -exp builds), since the default when creating a new build is to replace the previous trees with fresh, pristine trees. If you forget to use this then any local changes that are not also present in other trees will be lost. * By default we keep two builds for each arch/branch pair. These build IDs also may be referred to via "latest" and "previous" symlinks. When creating a new build, the old "previous" build is destroyed by default, unless it was originally created using the -keep switch. This prevents the build from being destroyed automatically. * By default when a build finishes all of the clients are completely cleaned up (i.e. all build data such as ports trees, tarballs, client chroots, etc are deleted). This is needed to save space on the clients. If you expect to *immediately* perform further builds after this one completes, the -nocleanup switch prevents this step. Otherwise they will just be set up again if further builds are scheduled. * Try to parallelize build pre-processing as much as possible, by running jobs in the background wherever possible. In several places we operate on the same parts of the filesystem from multiple jobs, so we can make good use of caching to improve performance * Clients no longer need to be set up explicitly at the start of the build, they will be set up on-demand when the first job is dispatched to them. This allows fast clients or those that already have been set up to begin building ports as soon as possible, while slow clients are set up in the background. It also improves robustness of client recovery, e.g. if the client was offline at the time of build startup but later brought back online. * Optimize copying back in the previous set of restricted packages by hardlinking instead of copying. TODO: The record of failed ports is arch/branch-global still. This is the only thing preventing us from running concurrent builds of the same arch/branch (e.g. while one is stuck building openoffice, the next build can start to keep the cluster busy). The difficulty is that one build from a later ports tree may signal that a build was successful, then a phase 2 build from an earlier ports tree may indicate that it was broken. The solution is probably to migrate this to a real database instead of a flat file, and query it for the set of broken ports as of a certain ports tree date.
* * Catch up to build ID directory changeskris2008-07-261-42/+155
| | | | | | | | | | | | | | | | | | * Clients no longer mount ports/src trees via NFS (even the FreeBSD.org local clients). This was putting too much load on the server and slowing down builds. * Instead ports and src .tbz files are pushed to the clients and unpacked. MD5 checksums are used to verify correctness * -force forces re-extraction of the tarballs even if they exist and appear to be checked out * Also unpack the compressed bindist TODO: When we are not using md or ZFS builds it would be even faster to keep an unpacked copy of the bindist on the scratch filesystem and hardlink the files into the target directory
* * Catch up to build ID directory changeskris2008-07-261-3/+24
| | | | | * Optimize by copying old packages using cpio -dumpl (i.e. create hardlink instead of copying the file).
* * Catch up to build ID directory changeskris2008-07-262-9/+16
|
* * Cleanupkris2008-07-261-50/+51
| | | | | * Catch up to build ID directory changes * Remove need for /etc/arch file
* * Cleanupkris2008-07-261-71/+73
| | | | | | * Catch up to build ID directory changes * Improved support for ZFS * Desupport X11BASE
* * Cleanupkris2008-07-261-75/+120
| | | | | | | | | | | | | * Catch up to build ID directory changes * Improved support for ZFS builds * Improved robustness * Report status verbosely to the caller; whether we succeeded in claiming a chroot, whether the caller needs to first set up the client, or whether a setup is in progress. * If we discover that the client has not been set up either because it freshly booted and newfs'ed its filesystem, or because a particular build has not yet been encountered, atomically claim a cookie and report this to the caller to act on
* * Cleanupkris2008-07-263-24/+50
| | | | * Catch up to build ID directory changes
* * Cleanupkris2008-07-261-19/+74
| | | | | | | * Catch up to build ID directory changes * Add helper functions for resolving a build ID symlink and validating an arch/branch combination (centralize instead of doing it in many scripts)
* * Desupport alpha and ia64kris2008-07-261-4/+3
| | | | * Catch up to build ID directory changes
* * Add commentskris2008-07-261-2/+2
|
* * Implement basename and dirname using shell builtinskris2008-07-261-0/+8
|
* * Cleanupkris2008-07-261-13/+15
| | | | | * Catch up to build ID directory changes * Record package build completion for reporting to ganglia
* * Cleanupkris2008-07-261-104/+160
| | | | | | | | | | | | | | * Catch up to build ID directory changes * Add support for ssh_cmd and scp_cmd to allow using HPN-SSH with the none cipher where possible (for performance) * Lazy client setup; claim-chroot will report if the client needs to be set up with this buildid, and we initiate the setup and poll until it is complete. This allows fast clients to begin building before slow ones have finished setting up. TODO: a better solution would be to avoid trying to dispatch jobs onto clients that are in the process of setting up, since they often have low loads and are picked preferentially by the job scheduler.
* * Cleanupkris2008-07-261-65/+41
| | | | | | | | | | * Remove vestiges of archaic support for building bindists from FTP snapshots; we haven't used this for years and building a world is no longer a challenge * Revert half-baked bindist generation number and make it per-buildid instead. Compress and md5 it for distribution to the clients. TODO: Merge with makeworld?
* * Cleanupkris2008-07-261-17/+24
| | | | | | * Catch up to build ID directory changes * Optimize by using ECHO_MSG=true instead of /usr/bin/true * Try harder to avoid pollution from local host
* * Cleanupkris2008-07-261-7/+18
| | | | * Catch up to build ID directory layout
* * Cleanupkris2008-07-261-51/+18
| | | | | | * Catch up to build ID directory changes * Export the INDEX_PRISTINE and INDEX_QUIET variables (old bug) * Desupport X11BASE
* * Cleanupkris2008-07-261-38/+39
| | | | | * Catch up to build ID directory changes * Desupport 5.x
* * Cleanupkris2008-07-261-15/+17
| | | | | * Catch up to build ID directory changes * Optimize by using __MAKE_SHELL=/rescue/sh
* Rewrite in python and combine the functions of the formerkris2008-07-261-35/+263
| | | | | | | | | checkmachines script. Polls build machines for their status either once-off or regularly as a daemon. Optionally it will update the queue entries but this remains subject to race conditions. TODO: Integrate with queue manager and forward machine status changes to it
* More verbose status reporting using key=value format. We now alsokris2008-07-261-8/+18
| | | | | report error status, architecture and OS version, and available build environments, as well as load and number of running jobs
* Major optimizations for 'make index' and other recursive traversalkris2008-07-201-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | targets. * Use /rescue/sh for index builds instead of /bin/sh, when it exists. The former is statically linked and faster to execute, which becomes significant when executing it tens of thousands of times. This trick can be used with other recursive targets by passing in __MAKE_SHELL. * Get rid of make variable assignments that use != command invocations in the critical path, using several methods: - rewriting logic to use shell or make builtins instead of external command executions - macroizing commands and executing them in the targets where they are needed instead of with every invocation of make - precomputing the results of invariant commands in bsd.port.subdir.mk and passing them in explicitly to child makes, and using this to avoid recalculation in all the children. NB: the commands are still run one per top-level subdirectory but this does not currently seem to be a major issue. They could be moved further up into the top-level Makefile at the cost of some cleanliness. - Committers are strongly discouraged from adding further "bare" != assignments to the ports tree, even in their own ports. One of the above strategies should be used to avoid future bloat. * Rewrite the core 'describe' target to work entirely within a single shell process using only builtin commands. The old version is retained as a backup for use on systems older than 603104, which does not have the make :u modifier. This cuts down the number of processes executed during the course of a 'make index' by an order of magnitude, and we are essentially now amortized to the minimum of a single make + sh instance per port, plus whatever commands the port makefile itself executes (which are usually unnecessary and bogus). * Less validation of the WWW: target is performed; this can become policed at a port level by portlint. Specifically we look at the second word of the first line beginning with "WWW:" in pkg-descr, and append "http://" to it unless it already begins with "http://", "https://" or "ftp://". Thanks to dougb for the idea of how to extract WWW: using shell builtins. * Use the "true" shell builtin instead of echo > /dev/null for a measurable decrease in CPU use. * Add a note about dubious escaping strategy in bsd.port.subdir.mk * Minor change in output of 'make describe': it no longer strips trailing CR characters from pkg-descr files with MSDOS CR/LF termination. Instead the makeindex perl script that post-processes make describe into the INDEX is tweaked to strip on input. The bottom line is that on my test hardware INDEX builds are now faster by more than a factor of 2 and with a reduction in system time by a factor of 4-8 depending on configuration.
* Have a different approach on how to check if the modules file has changed.edwin2008-07-141-9/+7
| | | | | | | | | | Because the $FreeBSD$ keyword isn't expanded in the new version, we can't just do a diff, check the return value and ignore the output. Every new modules file, changed or not with regarding to the contents, has at least four lines in the diff output (line number, old line, seperator, new line). Only commit it if there are more than four lines difference between it.
* Keep the sources of the CVSROOT-ports/modules update script safelyedwin2008-07-094-0/+361
| | | | in the ports CVS repository.
* [PATCH] Tools/scripts: Some cleanups, additions to bump_version.pledwin2008-07-061-28/+33
| | | | | | | | | | | | | | - added -c, doesn't change anything - added -n, deal with an already checkouted tree - removed negative logic in favor of 'unless' - switch to 3 arg form of open() - don't use globs for filehandles, this is been obsolete since at least 5.6.1 - handle possible errors in close() - allow CVSROOT to be overriden in the ENV PR: ports/125025 Submitted by: "Philip M. Gollucci" <pgollucci@p6m7g8.com>
* Reflect latest changes from production:linimon2008-07-021-39/+43
| | | | | | - no more 5-exp - add 8, 8-exp - fix two error-name hrefs
* This conversion script is no longer usefulkris2008-06-261-74/+0
|
* CVSROOT/modules no longer contains an entry per port, remove supporterwin2008-06-204-300/+9
| | | | for this from these scripts.
* Modernize this script a bit.kris2008-06-111-13/+10
| | | | | | | | | | * Remove 5.x support * Leave the archaic ftp snapshot support for now, it is not hurting anything but will not work * Be more careful when removing files (use absolute paths) * Switch to bindist/tmp for the tmp dir * Fix the recording of the bindist.tar generation number * Get rid of redundant or useless processing of the world image
* * Distfile collection is now the default; replace -distfiles with -nodistfileskris2008-06-111-9/+13
| | | | | | * Record the CVS update stamp in some extra places and make sure to remove it if the build is started with -noportscvs (since this probably means the ports tree was updated by hand at some random time)
* Add some test -d's to avoid cd'ing into directories that do not existkris2008-06-111-3/+6
|
* Major optimizations. Instead of copying the distfiles around, mvkris2008-06-111-11/+67
| | | | them in batches according to their target directory.
* Revive this script and make it useful. Transfer the distfiles using rsynckris2008-06-111-26/+23
| | | | and make sure they have been post-processed first.
* * Catch up to X11R6 removalkris2008-06-111-7/+12
| | | | | * Keep RESTRICTED distfiles in a separate DISTDIR so we can easily avoid accidentally publishing them to the FTP site (idea from des@)
* Add support for "PORTREVISION?=" and "PORTEPOCH"edwin2008-06-061-52/+62
| | | | Tested on: devel/gettext bump
* Rewrite this to make it more efficient (fewer external commandkris2008-06-031-138/+181
| | | | | | | invocations). It also fixes some edge cases that were not handled in the previous version. TODO: Correctly report IPv6 sockets (already in use by the sparc64 build)
* Remove support for FreeBSD 5.xerwin2008-06-011-21/+1
|
* Remove the force file, if it was used.linimon2008-05-291-0/+1
| | | | Forgotten by: linimon
* Add a force function here, just like processlogs.linimon2008-05-291-1/+1
|
* Add a note that processonelog and processlogs2 are finicky about thelinimon2008-05-291-0/+1
| | | | header format of the log files.
* Fix these after the 1.31 update to buildscript.linimon2008-05-292-5/+7
| | | | Forgotten by: pav
* Rewrite this in python instead of shell. Because we can read thekris2008-05-261-39/+55
| | | | | INDEX once and process internally instead of invoking many external utilities, runtime is improved from ~20 minutes to <10 seconds.
* NNew build scheduler written in python to replace the make+sh jobkris2008-05-102-0/+1040
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ordering, which had become too limited. We now build packages ordered by those that are part of the longest dependency chains first. This has the effect of building the deepest parts of the tree first and levelling out the tree height, hopefully avoiding the situation we currently face where there appear bottlenecks late in the build where the cluster becomes mostly idle while waiting for a few long dependency chains to finish building before the cluster can become fully loaded again. The algorithm is that we sort the list of remaining packages according to height (longest dependency chain), then add leaf packages from each in order until we have filled a queue of length between 100 and 200, to amortise the cost of this queue rebalancing while not losing the height averaging property. Jobs are dispatched from this queue into worker threads as machine slots become available. Unlike the make-based solution that required a fixed -j concurrency value and could not respond to addition/removal of build resources, we now can dynamically add new machines as they become available to the queue. The other advantage of using python is that we have more customisability and visibility into the build status, e.g. we periodically report the number of remaining packages, as well as the list of deepest packages that we are working on. TODO: * Implement mtime checking for parent package staleness, so that parents are rebuilt if the dependencies are touched more recently. Currently packages will not be rebuild if they exist, whether or not they are "stale" wrt their dependencies. * Offload the machine selection into an external queue manager. Currently the queue manager used here doesn't interoperate with the old one (getmachine/releasemachine) because it's not possible to use the lockf()-based mutual exclusion within a multithreaded client. Doing that will also allow for a more flexible job placement algorithm as well as finer queue customization.
* Add a tiny sh hack - ardiff - compares two archives.sat2008-05-072-0/+98
|
* Remove XFree86-4 from quickportspav2008-04-111-1/+1
|
* Parallelize to 4 concurrent jobspav2008-04-112-2/+2
|
* Include per-machine configuration and respect use_zfs flagpav2008-04-111-2/+3
|
* Sync with pointyhat (reorg)pav2008-04-111-9/+9
|
* - Add the port's Makefile ident string to the build log headerspav2008-03-131-2/+7
| | | | | | | PR: 113234 Submitted by: Andrej Zverev <andrey.zverev@electro-com.ru> - Sync with actual script on pointyhat (whitespace, mostly)
* - Don't write queue entry for machine that's not on mlist. This allows us topav2008-03-131-0/+6
| | | | | gracefully remove a node from the workload, and also it prevents build from stucking when machine is deleted from mlist.
* Make the INDEX_JOBS definition actually effectivepav2008-03-121-1/+1
|
* Remove support for 5-exp and add 7-exp, 8 and 8-experwin2008-01-155-11/+17
|
* Change homebrew locking routines with lockf(1) based locking.erwin2008-01-011-14/+4
|
* Add the standard 6-line header and URL to all build failure logs, notlinimon2007-12-241-1/+10
| | | | | | | | | just the plist ones. If the log is less than 1000 lines after the header, include it all; else, trim to last 1000 lines. This should help when deciding where to forward logs. Tested on: pointyhat
generated by cgit (git 2.34.1) at 2024-11-03 03:31:25 +0800