This is an outdated version of the HTCondor Manual. You can find current documentation at You can find current documentation at http://htcondor.org/manual



9.3 Stable Release Series 7.8

This is a stable release series of HTCondor. As usual, only bug fixes (and potentially, ports to new platforms) will be provided in future 7.8.x releases. New features will be added in the 7.9.x development series.

The details of each version are described below.



Version 7.8.8

Release Notes:

HTCondor version 7.8.8 released on March 28, 2013.

New Features:

When using glexec, HTCondor now automatically retries each glexec operation if glexec exits with an error code that is likely to be caused by a transient error, such as a communication error with the mapping service. Previously, any glexec error would cause the job to be put on hold. Now, the job will only go on hold if the maximum number of glexec retries is exceeded. (Ticket #2415).

Configuration Variable and ClassAd Attribute Additions and Changes:

The new configuration variable GLEXEC_RETRIES is an integer value that specifies the maximum number of times to retry a call to glexec when glexec exits with status 202 or 203, error codes that indicate a possible transient error condition. The default number of retries is 3. (Ticket #2415).

is an integer value that specifies the maximum number of times to retry a call to when exits with status 202 or 203, error codes that indicate a possible transient error condition. The default number of retries is 3. (Ticket #2415). The new configuration variable GLEXEC_RETRY_DELAY is an integer value that specifies the minimum number of seconds to wait between retries of a failed call to glexec. The default is 5 seconds. The actual delay to be used is determined by a random exponential backoff algorithm that chooses a delay with a minimum of the value of GLEXEC_RETRY_DELAY and a maximum of 100 times that value. (Ticket #2415).

Bugs Fixed:

Fixed a bug that caused the condor_gridmanager to frequently delegate the X.509 proxy for jobs of the condor grid type to the remote condor_schedd when the delegated proxy's lifetime is not limited. This occurred when configuration variable DELEGATE_JOB_GSI_CREDENTIALS_LIFETIME or job ClassAd attribute DelegateJobGSICredentialsLifetime was set to 0. (Ticket #3395).

to frequently delegate the X.509 proxy for jobs of the condor grid type to the remote when the delegated proxy's lifetime is not limited. This occurred when configuration variable or job ClassAd attribute was set to 0. (Ticket #3395). Fixed a bug in condor_advertise that could cause failure to publish ClassAds to condor_collector daemons other than the first one in the list of condor_collector daemons. (Ticket #3404).

that could cause failure to publish ClassAds to daemons other than the first one in the list of daemons. (Ticket #3404). (This bug was fixed in HTCondor version 7.8.4.) condor_userlog no longer ignores ULOG_JOB_RECONNECT_FAILED events. (Ticket #3215).

no longer ignores events. (Ticket #3215). Fixed a bug that caused cream grid jobs to become held with a HoldReason attribute stating "CREAM error: Transfer failed: globus_ftp_client: an invalid value for url was used" when the jobs did not have any input or output files to transfer. (Ticket #3415).

attribute stating when the jobs did not have any input or output files to transfer. (Ticket #3415). Fixed a bug that could cause HTCondor daemons to abort on condor_reconfig when the value of configuration variable STATISTICS_WINDOW_SECONDS was reduced. (Ticket #3443).

when the value of configuration variable was reduced. (Ticket #3443). Fixed a bug that could cause daemons using CCB to fail to reconnect to the CCB server after becoming disconnected. This condition would cause the daemon to become unreachable via CCB until the daemon was restarted. (Ticket #3476).

If condor_shared_port was using a dynamic port and the condor_master was using the shared port, then if condor_shared_port died, all subsequent attempts to restart it on a different port failed. (Ticket #3478).

was using a dynamic port and the was using the shared port, then if died, all subsequent attempts to restart it on a different port failed. (Ticket #3478). The nordugrid_gahp no longer exits if the job ClassAd contains a bad NordugridRSL attribute value. (Ticket #3495).

no longer exits if the job ClassAd contains a bad attribute value. (Ticket #3495). Fixed a bug that caused the command-line arguments of grid universe jobs of grid type cream to be ignored if specified using the new quoting syntax in the submit description file. (Ticket #3473).

Reduced the likelihood of a problem that caused the condor_master to restart some of its children after a recent reconfiguration, because the condor_master incorrectly concluded that the children were hung. (Ticket #3510).

Known Bugs:

None.

Additions and Changes to the Manual:

None.



Version 7.8.7

Release Notes:

HTCondor version 7.8.7 released on December 18, 2012.

New Features:

None.

Configuration Variable and ClassAd Attribute Additions and Changes:

None.

Bugs Fixed:

Known Bugs:

None.

Additions and Changes to the Manual:

The manual incorrectly identified configuration variable COLLECTOR_PERSISTENT_AD_LOG as PERSISTENT_AD_LOG . This has now been corrected throughout the manual. (Ticket #3205).



Version 7.8.6

Release Notes:

Condor version 7.8.6 released on October 25, 2012.

Security Item : This version contains an important security bug fix. See below for details of this and other bugs fixed.

Bugs Fixed:

Security Item : Fixed a bug which allowed jobs submitted to the standard universe to escalate privilege on the submit machine and execute code as root. (CVE-2012-5390)



Version 7.8.5

Release Notes:

Condor version 7.8.5 released on October 22, 2012.

New Features:

Condor now contains a tool called accountant_log_fixer, that can fix the damage to the file Accountantnew.log caused by a bug in the Condor version 7.8.4 condor_negotiator. (Ticket #3221).

Configuration Variable and ClassAd Attribute Additions and Changes:

None.

Bugs Fixed:

Fixed a problem with jobs that are submitted with noop_job = true These jobs would, in rare cases, cause the condor_schedd daemon to crash. (Ticket #3156).

These jobs would, in rare cases, cause the daemon to crash. (Ticket #3156). The condor_startd daemon crashed if a job failed to match a partitionable slot after the application of configuration variables of the MODIFY_REQUEST_EXPR_ category. (Ticket #3260).

daemon crashed if a job failed to match a partitionable slot after the application of configuration variables of the category. (Ticket #3260). The condor_schedd daemon would mark scheduler universe jobs as completed and remove them from the job queue, even when they should have been requeued, according to policy. This caused condor_dagman jobs to fail to restart. This bug exists in all Condor versions 7.8.0 through 7.8.4. Upon upgrading from these Condor versions, users will need to intervene in order to restart their condor_dagman jobs. condor_dagman should not need such intervention when upgrading from Condor version 7.8.5. To restart a condor_dagman job, the simplest solution is to issue the command condor_submit <DAGFile>.condor.sub where the original DAG was submitted with condor_submit <DAGFile> (Ticket #3207).

daemon would mark scheduler universe jobs as completed and remove them from the job queue, even when they should have been requeued, according to policy. This caused jobs to fail to restart. This bug exists in all Condor versions 7.8.0 through 7.8.4. Upon upgrading from these Condor versions, users will need to intervene in order to restart their jobs. should not need such intervention when upgrading from Condor version 7.8.5. To restart a job, the simplest solution is to issue the command where the original DAG was submitted with (Ticket #3207). The Condor version 7.8.4 condor_negotiator daemon wrote corrupt resource entries to the file Accountantnew.log , which it would then not be able to read. The Condor version 7.9.0 condor_negotiator daemon will abort when trying to read these corrupted resource entries. The condor_negotiator will now correct these corrupt resource entries over time. (Ticket #3221).

daemon wrote corrupt resource entries to the file , which it would then not be able to read. The Condor version 7.9.0 daemon will abort when trying to read these corrupted resource entries. The will now correct these corrupt resource entries over time. (Ticket #3221). Fixed a bug in which the condor_schedd statistics ClassAd attributes JobsAccumExecuteTime and JobsAccumPostExecuteTime were sometimes much too large for jobs that had been vacated and then restarted. Note that these currently undocumented attributes would only appear in the ClassAd if the verbosity level for condor_schedd statistics was set at the high value of 2 by the configuration variable STATISTICS_TO_PUBLISH . (Ticket #3227).

Known Bugs:

None.

Additions and Changes to the Manual:

None.



Version 7.8.4

Release Notes:

Condor version 7.8.4 released on September 19, 2012.

This release contains several important security fixes and all users should upgrade as soon as possible.

New Features:

None.

Configuration Variable and ClassAd Attribute Additions and Changes:

The new configuration variable GSI_AUTHZ_CONF fixes a bug in which an instance of Condor may utilize the wrong Globus mapping. The configuration variable defines a path and file name to the file that contains the Globus mapping library. See the complete definition at 3.3.26. (Ticket #2103).

Bugs Fixed:

Security Item : Some code that was no longer used was removed. The presence of this code could expose information which would allow an attacker to control another user's job. (CVE-2012-3493)

: Some code that was no longer used was removed. The presence of this code could expose information which would allow an attacker to control another user's job. (CVE-2012-3493) Security Item : Some code that was no longer used was removed. The presence of this code could have lead to a Denial-of-Service attack which would allow an attacker to remove another user's idle job. (CVE-2012-3491)

: Some code that was no longer used was removed. The presence of this code could have lead to a Denial-of-Service attack which would allow an attacker to remove another user's idle job. (CVE-2012-3491) Security Item : Filesystem (FS) authentication was improved to check the UNIX permissions of the directory used for authentication. Without this, an attacker may have been able to impersonate another submitter on the same submit machine. (CVE-2012-3492)

: Filesystem (FS) authentication was improved to check the UNIX permissions of the directory used for authentication. Without this, an attacker may have been able to impersonate another submitter on the same submit machine. (CVE-2012-3492) Security Item : Although not user-visible, there were multiple updates to remove places in the code where potential buffer overruns could occur, thus removing potential attacks. None were known to be exploitable.

: Although not user-visible, there were multiple updates to remove places in the code where potential buffer overruns could occur, thus removing potential attacks. None were known to be exploitable. Security Item : Although not user-visible, there were updates to the code to improve error checking of system calls, removing some potential security threats. None were known to be exploitable.

: Although not user-visible, there were updates to the code to improve error checking of system calls, removing some potential security threats. None were known to be exploitable. Fixed the condor_schedd daemon; it would crash when a submit description file contained a malformed $$() expansion macro that contained a period. (Ticket #3216).

daemon; it would crash when a submit description file contained a malformed expansion macro that contained a period. (Ticket #3216). Fixed a case in which a daemon could crash and leave behind a log file owned by root . This root -owned file would then cause subsequent attempts to restart the daemon to fail. (Ticket #2894).

. This -owned file would then cause subsequent attempts to restart the daemon to fail. (Ticket #2894). Fixed a special case bug in which configuration variables defined utilizing initial substrings of $(DOLLAR) , for example $(D) and $(DO) , were not expanded properly. (Ticket #3217).

, for example and , were not expanded properly. (Ticket #3217). The command condor_q -run now displays correct HOST field information for local universe jobs. (Ticket #3150).

Known Bugs:

None.

Additions and Changes to the Manual:

None.



Version 7.8.3

Release Notes:

Condor version 7.8.3 released on September 6, 2012.

New Features:

The libcondorapi library for reading and writing job event logs is again available as a shared library on Linux and Mac OS platforms. Since Condor 7.5.x, it had only been available as a static library. (Ticket #3047).

Configuration Variable and ClassAd Attribute Additions and Changes:

To avoid the output of an unnecessary DAGMan error message, the value of DAGMAN_LOG_ON_NFS_IS_ERROR is ignored when both CREATE_LOCKS_ON_LOCAL_DISK and ENABLE_USERLOG_LOCKING are True . (Ticket #3087).

Bugs Fixed:

Known Bugs:

None.

Additions and Changes to the Manual:

There is now documentation for the submit description file commands encrypt_input_files, encrypt_output_files, dont_encrypt_input_files, and dont_encrypt_output_files in the condor_submit manual page. These commands have been available since Condor version 6.7.2, but were never documented. See descriptions starting at 10. (Ticket #3174).



Version 7.8.2

Release Notes:

Condor version 7.8.2 released on August 14, 2012.

Security Item : Fixed a critical problem with DNS handling.

New Features:

None.

Configuration Variable and ClassAd Attribute Additions and Changes:

None.

Bugs Fixed:

Security Item : Fixed a critical problem with DNS handling.

Known Bugs:

None.

Additions and Changes to the Manual:

None.



Version 7.8.1

Release Notes:

Condor version 7.8.1 released on June 15, 2012.

New Features:

None.

Configuration Variable and ClassAd Attribute Additions and Changes:

(Added in 7.8.0.) The new configuration variable ENABLE_DEPRECATION_WARNINGS causes condor_submit to issue warnings when a job requests features that are no longer supported. (Ticket #2968).

causes to issue warnings when a job requests features that are no longer supported. (Ticket #2968). (Added in 7.7.6) The new configuration variable BATCH_GAHP should be used instead of PBS_GAHP , LSF_GAHP and SGE_GAHP . These older configuration variables are still recognized, but their use is now discouraged. (Ticket #2670).

should be used instead of , and . These older configuration variables are still recognized, but their use is now discouraged. (Ticket #2670). The default value for GROUP_SORT_EXPR was changed so that the <none> group would always negotiate last when using hierarchical group quotas. Associated with that, the default value for NEGOTIATOR_ALLOW_QUOTA_OVERSUBSCRIPTION was changed to True . These changes were made to make negotiation behave more like it did in the stable 7.4 series of Condor, before hierarchical group quotas were added. (Ticket #3040).

Bugs Fixed:

Fixed a bug that caused events to not be written to the job event log when the log is written in XML and a job policy expression triggering the event contains any double quote marks. (Ticket #3048).

Fixed a bug in the Condor init script that would cause the init script to hang if Condor was not running. (Ticket #2872).

Fixed a bug that caused parallel universe jobs using Parallel Scheduling Groups (see section 3.12.8) to occasionally stay idle even when there were available machines to run them. (Ticket #3017).

Fixed a bug that caused the condor_gridmanager to crash when attempting to submit jobs to a local PBS, LSF, or SGI cluster. (Ticket #3014).

to crash when attempting to submit jobs to a local PBS, LSF, or SGI cluster. (Ticket #3014). Fixed a bug in the handling of local universe jobs which caused the condor_schedd to log a spurious ERROR message every time a local universe job exited, and then further caused the statistics for local universe jobs to be incorrectly computed. (Ticket #3008).

to log a spurious message every time a local universe job exited, and then further caused the statistics for local universe jobs to be incorrectly computed. (Ticket #3008). Changed the internally used condor_ckpt_probe executable to link statically, which should make the checkpoint signature more resistant to non-significant changes in the system configuration. (Ticket #2901).

executable to link statically, which should make the checkpoint signature more resistant to non-significant changes in the system configuration. (Ticket #2901). Restored Globus and VOMS support for the Mac OS X platform. (Ticket #2991).

Fixed a bug when Condor runs under the PrivSep model, in which if a job created a hard link from one file to another, Condor was unable to transfer the files back to the submit side, and the job was put on hold. (Ticket #2987).

When configuration variables MaxJobRetirementTime or MachineMaxVacateTime were very large, estimates of machine draining badput and completion time were sometimes nonsensical because of integer overflow. (Ticket #3001).

or were very large, estimates of machine draining badput and completion time were sometimes nonsensical because of integer overflow. (Ticket #3001). Fixed a bug where per-job subdirectories and their contents in $(SPOOL) would not be removed when the associated job left the queue. (Ticket #2942).

would not be removed when the associated job left the queue. (Ticket #2942). Fixed a bug that could cause the condor_schedd to occasionally crash due to a race condition when running local universe jobs. Associated with the bug would be the error message No local universe jobs were expected to be running, but one just exited! (Ticket #3009).

Known Bugs:

None.

Additions and Changes to the Manual:

Submit description file commands introduced in Condor version 7.7.1 have now been documented. See the condor_submit manual page at 10 for the newly added definitions of ec2_availability_zone ec2_ebs_volumes ec2_elastic_ip ec2_keypair_file ec2_vpc_ip ec2_vpc_subnet

manual page at 10 for the newly added definitions of There is now a manual page for condor_router_rm , a script that provides additional features convenient for removing jobs managed by the Condor Job Router.

, a script that provides additional features convenient for removing jobs managed by the Condor Job Router. Documentation not completed for the 7.7.6 release is now available. The use of configuration variable BATCH_GAHP , as well as the use of the new grid_resource of type batch for local submission of PBS, LSF, and SGE jobs is documented. See section 5.3.5 for details. (Ticket #2670).



Version 7.8.0

Release Notes:

Condor version 7.8.0 released on May 10, 2012.

New Features:

(Added in 7.7.6.) The new -_condor_relocatable argument may be given as part of the invocation of a program that uses standalone checkpointing. This allows checkpointed programs to restart without attempting to change to their original directory. (Ticket #2877).

argument may be given as part of the invocation of a program that uses standalone checkpointing. This allows checkpointed programs to restart without attempting to change to their original directory. (Ticket #2877). (Added in 7.7.5.) Added the -absent flag to condor_status , which displays absent ClassAds. (Ticket #2690).

flag to , which displays absent ClassAds. (Ticket #2690). (Added in 7.7.5.) Implement absent ads, which help track pool membership in a persistent way. (Ticket #2608).

Configuration Variable and ClassAd Attribute Additions and Changes:

The job ClassAd attribute RemotePool is now saved in LastRemotePool when the job finishes running.

Bugs Fixed:

(Fixed in 7.7.6.) Fix -absent , -vm , and -java flags to condor_status so that they work with the -long option. (Ticket #2943).

, , and flags to so that they work with the option. (Ticket #2943). Support glob() on Scientific Linux 6 and others using the new Linux system call fstatat(), but only when not using remote system calls. (Ticket #2945).

Fixed potential startd crash introduced in v7.7.5 when claiming a partitionable slot that was in the Owner state. (Ticket #2936).

When ClassAd function stringListMember() is called with an empty string as the second argument, it now evaluates to False . Previously, it incorrectly evaluated to Undefined . (Ticket #2953).

. Previously, it incorrectly evaluated to . (Ticket #2953). Format tags %v and %V for the -format option now properly print all ClassAd value types. Previously, True and False were printed as integers, and new ClassAd types like lists and nested ClassAds could not be printed. (Ticket #2960).

option now properly print all ClassAd value types. Previously, and were printed as integers, and new ClassAd types like lists and nested ClassAds could not be printed. (Ticket #2960). Restored RCS keyword strings CondorVersion and CondorPlatform to the Condor binaries. These strings are found and printed by the ident program on Unix. They were missing in Condor versions 7.7.3 and later. (Ticket #2932).

program on Unix. They were missing in Condor versions 7.7.3 and later. (Ticket #2932). condor_job_router failed to route spooled source jobs. (Ticket #2955).

failed to route spooled source jobs. (Ticket #2955). Fixed a bug on Debian 6 and RHEL 6 that could cause standard universe jobs to never checkpoint. This would happen if the job triggered a call to NSCD (Name Service Caching Daemon) but NSCD wasn't running. Calls to NSCD can be triggered by a look up of a user account or resolving a machine hostname to an IP address. Now, NSCD is never consulted by a standard universe job (this was already the behavior on other platforms). (Ticket #2973).

Known Bugs:

None.

Additions and Changes to the Manual:

None.

htcondor-admin@cs.wisc.edu