CHANGES.txt 13 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314
  1. Next Release
  2. - Supervisorctl now reports a better error message when the main
  3. supervisor XML-RPC namespace is not registered. Thanks to
  4. Mike Orr for reporting this. (Mike Naberezny)
  5. - Create 'scripts' directory within supervisor package, move
  6. 'pidproxy.py' there, and place sample event listener and comm
  7. event programs within the directory.
  8. - When an event notification is buffered (either because a listener
  9. rejected it or because all listeners were busy when we attempted
  10. to send it originally), we now rebuffer it in a way that will
  11. result in it being retried earlier than it used to be.
  12. - When a listener process exits (unexpectedly) before transitioning
  13. from the BUSY state, rebuffer the event that was being processed.
  14. 3.0a2
  15. - Fixed the README.txt example for defining the supervisor RPC
  16. interface in the configuration file. Thanks to Drew Perttula.
  17. - Fixed a bug where process communication events would not have the
  18. proper payload if the payload data was very short.
  19. - when supervisord attempted to kill a process with SIGKILL after
  20. the process was not killed within "stopwaitsecs" using a "normal"
  21. kill signal, supervisord would crash with an improper
  22. AssertionError. Thanks to Calvin Hendryx-Parker.
  23. - On Linux, Supervisor would consume too much CPU in an effective
  24. "busywait" between the time a subprocess exited and the time at
  25. which supervisor was notified of its exit status. Thanks to Drew
  26. Perttula.
  27. - RPC interface behavior change: if the RPC method
  28. "sendProcessStdin" is called against a process that has closed its
  29. stdin file descriptor (e.g. it has done the equivalent of
  30. "sys.stdin.close(); os.close(0)"), we return a NO_FILE fault
  31. instead of accepting the data.
  32. - Changed the semantics of the process configuration 'autorestart'
  33. parameter with respect to processes which move between the RUNNING
  34. and EXITED state. 'autorestart' was previously a boolean. Now
  35. it's a trinary, accepting one of 'false', 'unexpected', or 'true'.
  36. If it's 'false', a process will never be automatically restarted
  37. from the EXITED state. If it's 'unexpected', a process that
  38. enters the EXITED state will be automatically restarted if it
  39. exited with an exit code that was not named in the process
  40. config's 'exitcodes' list. If it's 'true', a process that enters
  41. the EXITED state will be automatically restarted unconditionally.
  42. The default is now 'unexpected' (it was previously 'true'). The
  43. readdition of this feature is a reversion of the behavior change
  44. note in the changelog notes for 3.0a1 that asserted we never cared
  45. about the process' exit status when determining whether to restart
  46. it or not.
  47. - setup.py develop (and presumably setup.py install) would fail
  48. under Python 2.3.3, because setuptools attempted to import
  49. 'splituser' from urllib2, and it didn't exist.
  50. - It's now possible to use 'setup.py install' and 'setup.py develop'
  51. on systems which do not have a C compiler if you set the
  52. environment variable "NO_MELD3_EXTENSION_MODULES=1" in the shell
  53. in which you invoke these commands (versions of meld3 > 0.6.1
  54. respect this envvar and do not try to compile optional C
  55. extensions when it's set).
  56. - The test suite would fail on Python versions <= 2.3.3 because
  57. the "assertTrue" and "assertFalse" methods of unittest.TestCase
  58. didn't exist in those versions.
  59. - The 'supervisorctl' and 'supervisord' wrapper scripts were disused
  60. in favor of using setuptools' 'console_scripts' entry point settings.
  61. - Documentation files and the sample configuration file are put into
  62. the generated supervisor egg's 'doc' directory.
  63. _ Using the web interface would cause fairly dramatic memory
  64. leakage. We now require a version of meld3 that does not appear
  65. to leak memory from its C extensions (0.6.3).
  66. 3.0a1
  67. - Default config file comment documented 10 secs as default for
  68. 'startsecs' value in process config, in reality it was 1 sec.
  69. Thanks to Christoph Zwerschke.
  70. - Make note of subprocess environment behavior in README.txt.
  71. Thanks to Christoph Zwerschke.
  72. - New "strip_ansi" config file option attempts to strip ANSI escape
  73. sequences from logs for smaller/more readable logs (submitted by
  74. Mike Naberezny).
  75. - The XML-RPC method supervisor.getVersion() has been renamed for
  76. clarity to supervisor.getAPIVersion(). The old name is aliased
  77. for compatibility but is deprecated and will be removed in a
  78. future version (Mike Naberezny).
  79. - Improved web interface styling (Mike Naberezny, Derek DeVries)
  80. - The XML-RPC method supervisor.startProcess() now checks that
  81. the file exists and is executable (Mike Naberezny).
  82. - Two environment variables, "SUPERVISOR_PROCESS_NAME" and
  83. "SUPERVISOR_PROCESS_GROUP" are set in the environment of child
  84. processes, representing the name of the process and group in
  85. supervisor's configuration.
  86. - Process state map change: a process may now move directly from the
  87. STARTING state to the STOPPING state (as a result of a stop
  88. request).
  89. - Behavior change: if 'autorestart' is true, even if a process exits
  90. with an "expected" exit code, it will still be restarted. In the
  91. immediately prior release of supervisor, this was true anyway, and
  92. no one complained, so we're going to consider that the "officially
  93. correct" behavior from now on.
  94. - Supervisor now logs subprocess stdout and stderr independently.
  95. The old program config keys "logfile", "logfile_backups" and
  96. "logfile_maxbytes" are superseded by "stdout_logfile",
  97. "stdout_logfile_backups", and "stdout_logfile_maxbytes". Added
  98. keys include "stderr_logfile", "stderr_logfile_backups", and
  99. "stderr_logfile_maxbytes". An additional "redirect_stderr" key is
  100. used to cause program stderr output to be sent to its stdin
  101. channel. The keys "log_stderr" and "log_stdout" have been
  102. removed.
  103. - '[program:x]' config file sections now represent "homgeneous
  104. process groups" instead of single processes. A "numprocs" key in
  105. the section represents the number of processes that are in the
  106. group. A "process_name" key in the section allows composition of
  107. the each process' name within the homogeneous group.
  108. - A new kind of config file section, '[group:x]' now exists,
  109. allowing users to group heterogeneous processes together into a
  110. process group that can be controlled as a unit from a client.
  111. - Supervisord now emits "events" at certain points in its normal
  112. operation. These events include supervisor state change events,
  113. process state change events, and "process communication events".
  114. - A new kind of config file section '[eventlistener:x]' now exists.
  115. Each section represents an "event listener pool", which is a
  116. special kind of homogeneous process group. Each process in the
  117. pool is meant to receive supervisor "events" via its stdin and
  118. perform some notification (e.g. send a mail, log, make an http
  119. request, etc.)
  120. - Supervisord can now capture data between special tokens in
  121. subprocess stdout/stderr output and emit a "process communications
  122. event" as a result.
  123. - Supervisor's XML-RPC interface may be extended arbitrarily by
  124. programmers. Additional top-level namespace XML-RPC interfaces
  125. can be added using the '[rpcinterface:foo]' declaration in the
  126. configuration file.
  127. - New 'supervisor'-namespace XML-RPC methods have been added:
  128. getAPIVersion (returns the XML-RPC API version, the older
  129. "getVersion" is now deprecated), "startProcessGroup" (starts all
  130. processes in a supervisor process group), "stopProcessGroup"
  131. (stops all processes in a supervisor process group), and
  132. "sendProcessStdin" (sends data to a process' stdin file
  133. descriptor).
  134. - 'supervisor'-namespace XML-RPC methods which previously accepted
  135. ony a process name as "name" (startProcess, stopProcess,
  136. getProcessInfo, readProcessLog, tailProcessLog, and
  137. clearProcessLog) now accept a "name" which may contain both the
  138. process name and the process group name in the form
  139. 'groupname:procname'. For backwards compatibility purposes,
  140. "simple" names will also be accepted but will be expanded
  141. internally (e.g. if "foo" is sent as a name, it will be expanded
  142. to "foo:foo", representing the foo process within the foo process
  143. group).
  144. - 2.X versions of supervisorctl will work against supervisor 3.0
  145. servers in a degraded fashion, but 3.X versions of supervisorctl
  146. will not work at all against supervisor 2.X servers.
  147. Known issues:
  148. - supervisorctl and the web interface do not yet allow you to stop
  149. / start / restart a process group as a unit.
  150. - supervisorctl and the web interface do not allow you to tail or
  151. otherwise examine stderr log files of processes.
  152. - buffered event notifications may be lost at supervisor shutdown
  153. or restart time.
  154. Acknowledgements:
  155. Maintainable Software (http://www.maintainable.com) contracted
  156. Agendless Consulting to add the event notification features and
  157. extensible XML-RPC namespaces feature to supervisor.
  158. 2.2b1
  159. - Individual program configuration sections can now specify an
  160. environment.
  161. - Added a 'version' command to supervisorctl. This returns the
  162. version of the supervisor2 package which the remote supervisord
  163. process is using.
  164. 2.1
  165. - When supervisord was invoked more than once, and its configuration
  166. was set up to use a UNIX domain socket as the HTTP server, the
  167. socket file would be erased in error. The symptom of this was
  168. that a subsequent invocation of supervisorctl could not find the
  169. socket file, so the process could not be controlled (it and all of
  170. its subprocesses would need to be killed by hand).
  171. - Close subprocess file descriptors properly when a subprocess exits
  172. or otherwise dies. This should result in fewer "too many open
  173. files to spawn foo" messages when supervisor is left up for long
  174. periods of time.
  175. - When a process was not killable with a "normal" signal at shutdown
  176. time, too many "INFO: waiting for x to die" messages would be sent
  177. to the log until we ended up killing the process with a SIGKILL.
  178. Now a maximum of one every three seconds is sent up until SIGKILL
  179. time. Thanks to Ian Bicking.
  180. - Add an assertion: we never want to try to marshal None to XML-RPC
  181. callers. Issue 223 in the collector from vgatto indicates that
  182. somehow a supervisor XML-RPC method is returning None (which
  183. should never happen), but I cannot identify how. Maybe the
  184. assertion will give us more clues if it happens again.
  185. - Supervisor would crash when run under Python 2.5 because the
  186. xmlrpclib.Transport class in Python 2.5 changed in a
  187. backward-incompatible way. Thanks to Eric Westra for the bug
  188. report and a fix.
  189. - Tests now pass under Python 2.5.
  190. - Better supervisorctl reporting on stop requests that have a FAILED
  191. status.
  192. - Removed duplicated code (readLog/readMainLog), thanks to Mike
  193. Naberezny.
  194. - Added tailProcessLog command to the XML-RPC API. It provides a
  195. more efficient way to tail logs than readProcessLog(). Use
  196. readProcessLog() to read chunks and tailProcessLog() to tail.
  197. (thanks to Mike Naberezny).
  198. 2.1b2
  199. - Added new tailProcessLog() command to the XML-RPC API that
  200. is more efficient for just tailing than the existing
  201. readProcessLog() command (Mike Naberezny).
  202. 2.1b1
  203. - "supervisord -h" and "supervisorctl -h" did not work (traceback
  204. instead of showing help view (thanks to Damjan from Macedonia for
  205. the bug report).
  206. - Processes which started successfully after failing to start
  207. initially are no longer reported in BACKOFF state once they are
  208. started successfully (thanks to Damjan from Macdonia for the bug
  209. report).
  210. - Add new 'maintail' command to supervisorctl shell, which allows
  211. you to tail the 'main' supervisor log. This uses a new
  212. readMainLog xmlrpc API.
  213. - Various process-state-transition related changes, all internal.
  214. README.txt updated with new state transition map.
  215. - startProcess and startAllProcesses xmlrpc APIs changed: instead of
  216. accepting a timeout integer, these accept a wait boolean (timeout
  217. is implied by process' "startsecs" configuration). If wait is
  218. False, do not wait for startsecs.
  219. Known issues:
  220. Code does not match state transition map. Processes which are
  221. configured as autorestarting which start "successfully" but
  222. subsequently die after 'startsecs' go through the transitions
  223. RUNNING -> BACKOFF -> STARTING instead of the correct transitions
  224. RUNNING -> EXITED -> STARTING. This has no real negative effect,
  225. but should be fixed for correctness.
  226. 2.0
  227. - pidfile written in daemon mode had incorrect pid.
  228. - supervisorctl: tail (non -f) did not pass through proper error
  229. messages when supplied by the server.
  230. - Log signal name used to kill processes at debug level.
  231. - supervisorctl "tail -f" didn't work with supervisorctl sections
  232. configured with an absolute unix:// URL
  233. - New "environment" config file option allows you to add environment
  234. variable values to supervisord environment from config file.
  235. 2.0b1
  236. - fundamental rewrite based on 1.0.6, use distutils (only) for
  237. installation, use ConfigParser rather than ZConfig, use HTTP for
  238. wire protocol, web interface, less lies in supervisorctl.