1:mod:`logging.handlers` --- Logging handlers
2============================================
3
4.. module:: logging.handlers
5   :synopsis: Handlers for the logging module.
6
7.. moduleauthor:: Vinay Sajip <[email protected]>
8.. sectionauthor:: Vinay Sajip <[email protected]>
9
10**Source code:** :source:`Lib/logging/handlers.py`
11
12.. sidebar:: Important
13
14   This page contains only reference information. For tutorials,
15   please see
16
17   * :ref:`Basic Tutorial <logging-basic-tutorial>`
18   * :ref:`Advanced Tutorial <logging-advanced-tutorial>`
19   * :ref:`Logging Cookbook <logging-cookbook>`
20
21--------------
22
23.. currentmodule:: logging
24
25The following useful handlers are provided in the package. Note that three of
26the handlers (:class:`StreamHandler`, :class:`FileHandler` and
27:class:`NullHandler`) are actually defined in the :mod:`logging` module itself,
28but have been documented here along with the other handlers.
29
30.. _stream-handler:
31
32StreamHandler
33^^^^^^^^^^^^^
34
35The :class:`StreamHandler` class, located in the core :mod:`logging` package,
36sends logging output to streams such as *sys.stdout*, *sys.stderr* or any
37file-like object (or, more precisely, any object which supports :meth:`write`
38and :meth:`flush` methods).
39
40
41.. class:: StreamHandler(stream=None)
42
43   Returns a new instance of the :class:`StreamHandler` class. If *stream* is
44   specified, the instance will use it for logging output; otherwise, *sys.stderr*
45   will be used.
46
47
48   .. method:: emit(record)
49
50      If a formatter is specified, it is used to format the record. The record
51      is then written to the stream followed by :attr:`terminator`. If exception information
52      is present, it is formatted using :func:`traceback.print_exception` and
53      appended to the stream.
54
55
56   .. method:: flush()
57
58      Flushes the stream by calling its :meth:`flush` method. Note that the
59      :meth:`close` method is inherited from :class:`~logging.Handler` and so
60      does no output, so an explicit :meth:`flush` call may be needed at times.
61
62   .. method:: setStream(stream)
63
64      Sets the instance's stream to the specified value, if it is different.
65      The old stream is flushed before the new stream is set.
66
67      :param stream: The stream that the handler should use.
68
69      :return: the old stream, if the stream was changed, or *None* if it wasn't.
70
71      .. versionadded:: 3.7
72
73   .. attribute:: terminator
74
75      String used as the terminator when writing a formatted record to a stream.
76      Default value is ``'\n'``.
77
78      If you don't want a newline termination, you can set the handler instance's
79      ``terminator`` attribute to the empty string.
80
81      In earlier versions, the terminator was hardcoded as ``'\n'``.
82
83      .. versionadded:: 3.2
84
85
86.. _file-handler:
87
88FileHandler
89^^^^^^^^^^^
90
91The :class:`FileHandler` class, located in the core :mod:`logging` package,
92sends logging output to a disk file.  It inherits the output functionality from
93:class:`StreamHandler`.
94
95
96.. class:: FileHandler(filename, mode='a', encoding=None, delay=False, errors=None)
97
98   Returns a new instance of the :class:`FileHandler` class. The specified file is
99   opened and used as the stream for logging. If *mode* is not specified,
100   :const:`'a'` is used.  If *encoding* is not ``None``, it is used to open the file
101   with that encoding.  If *delay* is true, then file opening is deferred until the
102   first call to :meth:`emit`. By default, the file grows indefinitely. If
103   *errors* is specified, it's used to determine how encoding errors are handled.
104
105   .. versionchanged:: 3.6
106      As well as string values, :class:`~pathlib.Path` objects are also accepted
107      for the *filename* argument.
108
109   .. versionchanged:: 3.9
110      The *errors* parameter was added.
111
112   .. method:: close()
113
114      Closes the file.
115
116   .. method:: emit(record)
117
118      Outputs the record to the file.
119
120      Note that if the file was closed due to logging shutdown at exit and the file
121      mode is 'w', the record will not be emitted (see :issue:`42378`).
122
123
124.. _null-handler:
125
126NullHandler
127^^^^^^^^^^^
128
129.. versionadded:: 3.1
130
131The :class:`NullHandler` class, located in the core :mod:`logging` package,
132does not do any formatting or output. It is essentially a 'no-op' handler
133for use by library developers.
134
135.. class:: NullHandler()
136
137   Returns a new instance of the :class:`NullHandler` class.
138
139   .. method:: emit(record)
140
141      This method does nothing.
142
143   .. method:: handle(record)
144
145      This method does nothing.
146
147   .. method:: createLock()
148
149      This method returns ``None`` for the lock, since there is no
150      underlying I/O to which access needs to be serialized.
151
152
153See :ref:`library-config` for more information on how to use
154:class:`NullHandler`.
155
156.. _watched-file-handler:
157
158WatchedFileHandler
159^^^^^^^^^^^^^^^^^^
160
161.. currentmodule:: logging.handlers
162
163The :class:`WatchedFileHandler` class, located in the :mod:`logging.handlers`
164module, is a :class:`FileHandler` which watches the file it is logging to. If
165the file changes, it is closed and reopened using the file name.
166
167A file change can happen because of usage of programs such as *newsyslog* and
168*logrotate* which perform log file rotation. This handler, intended for use
169under Unix/Linux, watches the file to see if it has changed since the last emit.
170(A file is deemed to have changed if its device or inode have changed.) If the
171file has changed, the old file stream is closed, and the file opened to get a
172new stream.
173
174This handler is not appropriate for use under Windows, because under Windows
175open log files cannot be moved or renamed - logging opens the files with
176exclusive locks - and so there is no need for such a handler. Furthermore,
177*ST_INO* is not supported under Windows; :func:`~os.stat` always returns zero
178for this value.
179
180
181.. class:: WatchedFileHandler(filename, mode='a', encoding=None, delay=False, errors=None)
182
183   Returns a new instance of the :class:`WatchedFileHandler` class. The specified
184   file is opened and used as the stream for logging. If *mode* is not specified,
185   :const:`'a'` is used.  If *encoding* is not ``None``, it is used to open the file
186   with that encoding.  If *delay* is true, then file opening is deferred until the
187   first call to :meth:`emit`.  By default, the file grows indefinitely. If
188   *errors* is provided, it determines how encoding errors are handled.
189
190   .. versionchanged:: 3.6
191      As well as string values, :class:`~pathlib.Path` objects are also accepted
192      for the *filename* argument.
193
194   .. versionchanged:: 3.9
195      The *errors* parameter was added.
196
197   .. method:: reopenIfNeeded()
198
199      Checks to see if the file has changed.  If it has, the existing stream is
200      flushed and closed and the file opened again, typically as a precursor to
201      outputting the record to the file.
202
203      .. versionadded:: 3.6
204
205
206   .. method:: emit(record)
207
208      Outputs the record to the file, but first calls :meth:`reopenIfNeeded` to
209      reopen the file if it has changed.
210
211.. _base-rotating-handler:
212
213BaseRotatingHandler
214^^^^^^^^^^^^^^^^^^^
215
216The :class:`BaseRotatingHandler` class, located in the :mod:`logging.handlers`
217module, is the base class for the rotating file handlers,
218:class:`RotatingFileHandler` and :class:`TimedRotatingFileHandler`. You should
219not need to instantiate this class, but it has attributes and methods you may
220need to override.
221
222.. class:: BaseRotatingHandler(filename, mode, encoding=None, delay=False, errors=None)
223
224   The parameters are as for :class:`FileHandler`. The attributes are:
225
226   .. attribute:: namer
227
228      If this attribute is set to a callable, the :meth:`rotation_filename`
229      method delegates to this callable. The parameters passed to the callable
230      are those passed to :meth:`rotation_filename`.
231
232      .. note:: The namer function is called quite a few times during rollover,
233         so it should be as simple and as fast as possible. It should also
234         return the same output every time for a given input, otherwise the
235         rollover behaviour may not work as expected.
236
237         It's also worth noting that care should be taken when using a namer to
238         preserve certain attributes in the filename which are used during rotation.
239         For example, :class:`RotatingFileHandler` expects to have a set of log files
240         whose names contain successive integers, so that rotation works as expected,
241         and :class:`TimedRotatingFileHandler` deletes old log files (based on the
242         ``backupCount`` parameter passed to the handler's initializer) by determining
243         the oldest files to delete. For this to happen, the filenames should be
244         sortable using the date/time portion of the filename, and a namer needs to
245         respect this. (If a namer is wanted that doesn't respect this scheme, it will
246         need to be used in a subclass of :class:`TimedRotatingFileHandler` which
247         overrides the :meth:`~TimedRotatingFileHandler.getFilesToDelete` method to
248         fit in with the custom naming scheme.)
249
250      .. versionadded:: 3.3
251
252
253   .. attribute:: BaseRotatingHandler.rotator
254
255      If this attribute is set to a callable, the :meth:`rotate` method
256      delegates to this callable.  The parameters passed to the callable are
257      those passed to :meth:`rotate`.
258
259      .. versionadded:: 3.3
260
261   .. method:: BaseRotatingHandler.rotation_filename(default_name)
262
263      Modify the filename of a log file when rotating.
264
265      This is provided so that a custom filename can be provided.
266
267      The default implementation calls the 'namer' attribute of the handler,
268      if it's callable, passing the default name to it. If the attribute isn't
269      callable (the default is ``None``), the name is returned unchanged.
270
271      :param default_name: The default name for the log file.
272
273      .. versionadded:: 3.3
274
275
276   .. method:: BaseRotatingHandler.rotate(source, dest)
277
278      When rotating, rotate the current log.
279
280      The default implementation calls the 'rotator' attribute of the handler,
281      if it's callable, passing the source and dest arguments to it. If the
282      attribute isn't callable (the default is ``None``), the source is simply
283      renamed to the destination.
284
285      :param source: The source filename. This is normally the base
286                     filename, e.g. 'test.log'.
287      :param dest:   The destination filename. This is normally
288                     what the source is rotated to, e.g. 'test.log.1'.
289
290      .. versionadded:: 3.3
291
292The reason the attributes exist is to save you having to subclass - you can use
293the same callables for instances of :class:`RotatingFileHandler` and
294:class:`TimedRotatingFileHandler`. If either the namer or rotator callable
295raises an exception, this will be handled in the same way as any other
296exception during an :meth:`emit` call, i.e. via the :meth:`handleError` method
297of the handler.
298
299If you need to make more significant changes to rotation processing, you can
300override the methods.
301
302For an example, see :ref:`cookbook-rotator-namer`.
303
304
305.. _rotating-file-handler:
306
307RotatingFileHandler
308^^^^^^^^^^^^^^^^^^^
309
310The :class:`RotatingFileHandler` class, located in the :mod:`logging.handlers`
311module, supports rotation of disk log files.
312
313
314.. class:: RotatingFileHandler(filename, mode='a', maxBytes=0, backupCount=0, encoding=None, delay=False, errors=None)
315
316   Returns a new instance of the :class:`RotatingFileHandler` class. The specified
317   file is opened and used as the stream for logging. If *mode* is not specified,
318   ``'a'`` is used.  If *encoding* is not ``None``, it is used to open the file
319   with that encoding.  If *delay* is true, then file opening is deferred until the
320   first call to :meth:`emit`.  By default, the file grows indefinitely. If
321   *errors* is provided, it determines how encoding errors are handled.
322
323   You can use the *maxBytes* and *backupCount* values to allow the file to
324   :dfn:`rollover` at a predetermined size. When the size is about to be exceeded,
325   the file is closed and a new file is silently opened for output. Rollover occurs
326   whenever the current log file is nearly *maxBytes* in length; but if either of
327   *maxBytes* or *backupCount* is zero, rollover never occurs, so you generally want
328   to set *backupCount* to at least 1, and have a non-zero *maxBytes*.
329   When *backupCount* is non-zero, the system will save old log files by appending
330   the extensions '.1', '.2' etc., to the filename. For example, with a *backupCount*
331   of 5 and a base file name of :file:`app.log`, you would get :file:`app.log`,
332   :file:`app.log.1`, :file:`app.log.2`, up to :file:`app.log.5`. The file being
333   written to is always :file:`app.log`.  When this file is filled, it is closed
334   and renamed to :file:`app.log.1`, and if files :file:`app.log.1`,
335   :file:`app.log.2`, etc. exist, then they are renamed to :file:`app.log.2`,
336   :file:`app.log.3` etc. respectively.
337
338   .. versionchanged:: 3.6
339      As well as string values, :class:`~pathlib.Path` objects are also accepted
340      for the *filename* argument.
341
342   .. versionchanged:: 3.9
343      The *errors* parameter was added.
344
345   .. method:: doRollover()
346
347      Does a rollover, as described above.
348
349
350   .. method:: emit(record)
351
352      Outputs the record to the file, catering for rollover as described
353      previously.
354
355.. _timed-rotating-file-handler:
356
357TimedRotatingFileHandler
358^^^^^^^^^^^^^^^^^^^^^^^^
359
360The :class:`TimedRotatingFileHandler` class, located in the
361:mod:`logging.handlers` module, supports rotation of disk log files at certain
362timed intervals.
363
364
365.. class:: TimedRotatingFileHandler(filename, when='h', interval=1, backupCount=0, encoding=None, delay=False, utc=False, atTime=None, errors=None)
366
367   Returns a new instance of the :class:`TimedRotatingFileHandler` class. The
368   specified file is opened and used as the stream for logging. On rotating it also
369   sets the filename suffix. Rotating happens based on the product of *when* and
370   *interval*.
371
372   You can use the *when* to specify the type of *interval*. The list of possible
373   values is below.  Note that they are not case sensitive.
374
375   +----------------+----------------------------+-------------------------+
376   | Value          | Type of interval           | If/how *atTime* is used |
377   +================+============================+=========================+
378   | ``'S'``        | Seconds                    | Ignored                 |
379   +----------------+----------------------------+-------------------------+
380   | ``'M'``        | Minutes                    | Ignored                 |
381   +----------------+----------------------------+-------------------------+
382   | ``'H'``        | Hours                      | Ignored                 |
383   +----------------+----------------------------+-------------------------+
384   | ``'D'``        | Days                       | Ignored                 |
385   +----------------+----------------------------+-------------------------+
386   | ``'W0'-'W6'``  | Weekday (0=Monday)         | Used to compute initial |
387   |                |                            | rollover time           |
388   +----------------+----------------------------+-------------------------+
389   | ``'midnight'`` | Roll over at midnight, if  | Used to compute initial |
390   |                | *atTime* not specified,    | rollover time           |
391   |                | else at time *atTime*      |                         |
392   +----------------+----------------------------+-------------------------+
393
394   When using weekday-based rotation, specify 'W0' for Monday, 'W1' for
395   Tuesday, and so on up to 'W6' for Sunday. In this case, the value passed for
396   *interval* isn't used.
397
398   The system will save old log files by appending extensions to the filename.
399   The extensions are date-and-time based, using the strftime format
400   ``%Y-%m-%d_%H-%M-%S`` or a leading portion thereof, depending on the
401   rollover interval.
402
403   When computing the next rollover time for the first time (when the handler
404   is created), the last modification time of an existing log file, or else
405   the current time, is used to compute when the next rotation will occur.
406
407   If the *utc* argument is true, times in UTC will be used; otherwise
408   local time is used.
409
410   If *backupCount* is nonzero, at most *backupCount* files
411   will be kept, and if more would be created when rollover occurs, the oldest
412   one is deleted. The deletion logic uses the interval to determine which
413   files to delete, so changing the interval may leave old files lying around.
414
415   If *delay* is true, then file opening is deferred until the first call to
416   :meth:`emit`.
417
418   If *atTime* is not ``None``, it must be a ``datetime.time`` instance which
419   specifies the time of day when rollover occurs, for the cases where rollover
420   is set to happen "at midnight" or "on a particular weekday". Note that in
421   these cases, the *atTime* value is effectively used to compute the *initial*
422   rollover, and subsequent rollovers would be calculated via the normal
423   interval calculation.
424
425   If *errors* is specified, it's used to determine how encoding errors are
426   handled.
427
428   .. note:: Calculation of the initial rollover time is done when the handler
429      is initialised. Calculation of subsequent rollover times is done only
430      when rollover occurs, and rollover occurs only when emitting output. If
431      this is not kept in mind, it might lead to some confusion. For example,
432      if an interval of "every minute" is set, that does not mean you will
433      always see log files with times (in the filename) separated by a minute;
434      if, during application execution, logging output is generated more
435      frequently than once a minute, *then* you can expect to see log files
436      with times separated by a minute. If, on the other hand, logging messages
437      are only output once every five minutes (say), then there will be gaps in
438      the file times corresponding to the minutes where no output (and hence no
439      rollover) occurred.
440
441   .. versionchanged:: 3.4
442      *atTime* parameter was added.
443
444   .. versionchanged:: 3.6
445      As well as string values, :class:`~pathlib.Path` objects are also accepted
446      for the *filename* argument.
447
448   .. versionchanged:: 3.9
449      The *errors* parameter was added.
450
451   .. method:: doRollover()
452
453      Does a rollover, as described above.
454
455   .. method:: emit(record)
456
457      Outputs the record to the file, catering for rollover as described above.
458
459   .. method:: getFilesToDelete()
460
461      Returns a list of filenames which should be deleted as part of rollover. These
462      are the absolute paths of the oldest backup log files written by the handler.
463
464.. _socket-handler:
465
466SocketHandler
467^^^^^^^^^^^^^
468
469The :class:`SocketHandler` class, located in the :mod:`logging.handlers` module,
470sends logging output to a network socket. The base class uses a TCP socket.
471
472
473.. class:: SocketHandler(host, port)
474
475   Returns a new instance of the :class:`SocketHandler` class intended to
476   communicate with a remote machine whose address is given by *host* and *port*.
477
478   .. versionchanged:: 3.4
479      If ``port`` is specified as ``None``, a Unix domain socket is created
480      using the value in ``host`` - otherwise, a TCP socket is created.
481
482   .. method:: close()
483
484      Closes the socket.
485
486
487   .. method:: emit()
488
489      Pickles the record's attribute dictionary and writes it to the socket in
490      binary format. If there is an error with the socket, silently drops the
491      packet. If the connection was previously lost, re-establishes the
492      connection. To unpickle the record at the receiving end into a
493      :class:`~logging.LogRecord`, use the :func:`~logging.makeLogRecord`
494      function.
495
496
497   .. method:: handleError()
498
499      Handles an error which has occurred during :meth:`emit`. The most likely
500      cause is a lost connection. Closes the socket so that we can retry on the
501      next event.
502
503
504   .. method:: makeSocket()
505
506      This is a factory method which allows subclasses to define the precise
507      type of socket they want. The default implementation creates a TCP socket
508      (:const:`socket.SOCK_STREAM`).
509
510
511   .. method:: makePickle(record)
512
513      Pickles the record's attribute dictionary in binary format with a length
514      prefix, and returns it ready for transmission across the socket. The
515      details of this operation are equivalent to::
516
517          data = pickle.dumps(record_attr_dict, 1)
518          datalen = struct.pack('>L', len(data))
519          return datalen + data
520
521      Note that pickles aren't completely secure. If you are concerned about
522      security, you may want to override this method to implement a more secure
523      mechanism. For example, you can sign pickles using HMAC and then verify
524      them on the receiving end, or alternatively you can disable unpickling of
525      global objects on the receiving end.
526
527
528   .. method:: send(packet)
529
530      Send a pickled byte-string *packet* to the socket. The format of the sent
531      byte-string is as described in the documentation for
532      :meth:`~SocketHandler.makePickle`.
533
534      This function allows for partial sends, which can happen when the network
535      is busy.
536
537
538   .. method:: createSocket()
539
540      Tries to create a socket; on failure, uses an exponential back-off
541      algorithm.  On initial failure, the handler will drop the message it was
542      trying to send.  When subsequent messages are handled by the same
543      instance, it will not try connecting until some time has passed.  The
544      default parameters are such that the initial delay is one second, and if
545      after that delay the connection still can't be made, the handler will
546      double the delay each time up to a maximum of 30 seconds.
547
548      This behaviour is controlled by the following handler attributes:
549
550      * ``retryStart`` (initial delay, defaulting to 1.0 seconds).
551      * ``retryFactor`` (multiplier, defaulting to 2.0).
552      * ``retryMax`` (maximum delay, defaulting to 30.0 seconds).
553
554      This means that if the remote listener starts up *after* the handler has
555      been used, you could lose messages (since the handler won't even attempt
556      a connection until the delay has elapsed, but just silently drop messages
557      during the delay period).
558
559
560.. _datagram-handler:
561
562DatagramHandler
563^^^^^^^^^^^^^^^
564
565The :class:`DatagramHandler` class, located in the :mod:`logging.handlers`
566module, inherits from :class:`SocketHandler` to support sending logging messages
567over UDP sockets.
568
569
570.. class:: DatagramHandler(host, port)
571
572   Returns a new instance of the :class:`DatagramHandler` class intended to
573   communicate with a remote machine whose address is given by *host* and *port*.
574
575   .. note:: As UDP is not a streaming protocol, there is no persistent connection
576      between an instance of this handler and *host*. For this reason, when using a
577      network socket, a DNS lookup might have to be made each time an event is
578      logged, which can introduce some latency into the system. If this affects you,
579      you can do a lookup yourself and initialize this handler using the looked-up IP
580      address rather than the hostname.
581
582   .. versionchanged:: 3.4
583      If ``port`` is specified as ``None``, a Unix domain socket is created
584      using the value in ``host`` - otherwise, a UDP socket is created.
585
586   .. method:: emit()
587
588      Pickles the record's attribute dictionary and writes it to the socket in
589      binary format. If there is an error with the socket, silently drops the
590      packet. To unpickle the record at the receiving end into a
591      :class:`~logging.LogRecord`, use the :func:`~logging.makeLogRecord`
592      function.
593
594
595   .. method:: makeSocket()
596
597      The factory method of :class:`SocketHandler` is here overridden to create
598      a UDP socket (:const:`socket.SOCK_DGRAM`).
599
600
601   .. method:: send(s)
602
603      Send a pickled byte-string to a socket. The format of the sent byte-string
604      is as described in the documentation for :meth:`SocketHandler.makePickle`.
605
606
607.. _syslog-handler:
608
609SysLogHandler
610^^^^^^^^^^^^^
611
612The :class:`SysLogHandler` class, located in the :mod:`logging.handlers` module,
613supports sending logging messages to a remote or local Unix syslog.
614
615
616.. class:: SysLogHandler(address=('localhost', SYSLOG_UDP_PORT), facility=LOG_USER, socktype=socket.SOCK_DGRAM)
617
618   Returns a new instance of the :class:`SysLogHandler` class intended to
619   communicate with a remote Unix machine whose address is given by *address* in
620   the form of a ``(host, port)`` tuple.  If *address* is not specified,
621   ``('localhost', 514)`` is used.  The address is used to open a socket.  An
622   alternative to providing a ``(host, port)`` tuple is providing an address as a
623   string, for example '/dev/log'. In this case, a Unix domain socket is used to
624   send the message to the syslog. If *facility* is not specified,
625   :const:`LOG_USER` is used. The type of socket opened depends on the
626   *socktype* argument, which defaults to :const:`socket.SOCK_DGRAM` and thus
627   opens a UDP socket. To open a TCP socket (for use with the newer syslog
628   daemons such as rsyslog), specify a value of :const:`socket.SOCK_STREAM`.
629
630   Note that if your server is not listening on UDP port 514,
631   :class:`SysLogHandler` may appear not to work. In that case, check what
632   address you should be using for a domain socket - it's system dependent.
633   For example, on Linux it's usually '/dev/log' but on OS/X it's
634   '/var/run/syslog'. You'll need to check your platform and use the
635   appropriate address (you may need to do this check at runtime if your
636   application needs to run on several platforms). On Windows, you pretty
637   much have to use the UDP option.
638
639   .. note:: On macOS 12.x (Monterey), Apple has changed the behaviour of their
640      syslog daemon - it no longer listens on a domain socket. Therefore, you cannot
641      expect :class:`SysLogHandler` to work on this system.
642
643      See :gh:`91070` for more information.
644
645   .. versionchanged:: 3.2
646      *socktype* was added.
647
648
649   .. method:: close()
650
651      Closes the socket to the remote host.
652
653   .. method:: createSocket()
654
655      Tries to create a socket and, if it's not a datagram socket, connect it
656      to the other end. This method is called during handler initialization,
657      but it's not regarded as an error if the other end isn't listening at
658      this point - the method will be called again when emitting an event, if
659      but it's not regarded as an error if the other end isn't listening yet
660      --- the method will be called again when emitting an event,
661      if there is no socket at that point.
662
663      .. versionadded:: 3.11
664
665   .. method:: emit(record)
666
667      The record is formatted, and then sent to the syslog server. If exception
668      information is present, it is *not* sent to the server.
669
670      .. versionchanged:: 3.2.1
671         (See: :issue:`12168`.) In earlier versions, the message sent to the
672         syslog daemons was always terminated with a NUL byte, because early
673         versions of these daemons expected a NUL terminated message - even
674         though it's not in the relevant specification (:rfc:`5424`). More recent
675         versions of these daemons don't expect the NUL byte but strip it off
676         if it's there, and even more recent daemons (which adhere more closely
677         to RFC 5424) pass the NUL byte on as part of the message.
678
679         To enable easier handling of syslog messages in the face of all these
680         differing daemon behaviours, the appending of the NUL byte has been
681         made configurable, through the use of a class-level attribute,
682         ``append_nul``. This defaults to ``True`` (preserving the existing
683         behaviour) but can be set to ``False`` on a ``SysLogHandler`` instance
684         in order for that instance to *not* append the NUL terminator.
685
686      .. versionchanged:: 3.3
687         (See: :issue:`12419`.) In earlier versions, there was no facility for
688         an "ident" or "tag" prefix to identify the source of the message. This
689         can now be specified using a class-level attribute, defaulting to
690         ``""`` to preserve existing behaviour, but which can be overridden on
691         a ``SysLogHandler`` instance in order for that instance to prepend
692         the ident to every message handled. Note that the provided ident must
693         be text, not bytes, and is prepended to the message exactly as is.
694
695   .. method:: encodePriority(facility, priority)
696
697      Encodes the facility and priority into an integer. You can pass in strings
698      or integers - if strings are passed, internal mapping dictionaries are
699      used to convert them to integers.
700
701      The symbolic ``LOG_`` values are defined in :class:`SysLogHandler` and
702      mirror the values defined in the ``sys/syslog.h`` header file.
703
704      **Priorities**
705
706      +--------------------------+---------------+
707      | Name (string)            | Symbolic value|
708      +==========================+===============+
709      | ``alert``                | LOG_ALERT     |
710      +--------------------------+---------------+
711      | ``crit`` or ``critical`` | LOG_CRIT      |
712      +--------------------------+---------------+
713      | ``debug``                | LOG_DEBUG     |
714      +--------------------------+---------------+
715      | ``emerg`` or ``panic``   | LOG_EMERG     |
716      +--------------------------+---------------+
717      | ``err`` or ``error``     | LOG_ERR       |
718      +--------------------------+---------------+
719      | ``info``                 | LOG_INFO      |
720      +--------------------------+---------------+
721      | ``notice``               | LOG_NOTICE    |
722      +--------------------------+---------------+
723      | ``warn`` or ``warning``  | LOG_WARNING   |
724      +--------------------------+---------------+
725
726      **Facilities**
727
728      +---------------+---------------+
729      | Name (string) | Symbolic value|
730      +===============+===============+
731      | ``auth``      | LOG_AUTH      |
732      +---------------+---------------+
733      | ``authpriv``  | LOG_AUTHPRIV  |
734      +---------------+---------------+
735      | ``cron``      | LOG_CRON      |
736      +---------------+---------------+
737      | ``daemon``    | LOG_DAEMON    |
738      +---------------+---------------+
739      | ``ftp``       | LOG_FTP       |
740      +---------------+---------------+
741      | ``kern``      | LOG_KERN      |
742      +---------------+---------------+
743      | ``lpr``       | LOG_LPR       |
744      +---------------+---------------+
745      | ``mail``      | LOG_MAIL      |
746      +---------------+---------------+
747      | ``news``      | LOG_NEWS      |
748      +---------------+---------------+
749      | ``syslog``    | LOG_SYSLOG    |
750      +---------------+---------------+
751      | ``user``      | LOG_USER      |
752      +---------------+---------------+
753      | ``uucp``      | LOG_UUCP      |
754      +---------------+---------------+
755      | ``local0``    | LOG_LOCAL0    |
756      +---------------+---------------+
757      | ``local1``    | LOG_LOCAL1    |
758      +---------------+---------------+
759      | ``local2``    | LOG_LOCAL2    |
760      +---------------+---------------+
761      | ``local3``    | LOG_LOCAL3    |
762      +---------------+---------------+
763      | ``local4``    | LOG_LOCAL4    |
764      +---------------+---------------+
765      | ``local5``    | LOG_LOCAL5    |
766      +---------------+---------------+
767      | ``local6``    | LOG_LOCAL6    |
768      +---------------+---------------+
769      | ``local7``    | LOG_LOCAL7    |
770      +---------------+---------------+
771
772   .. method:: mapPriority(levelname)
773
774      Maps a logging level name to a syslog priority name.
775      You may need to override this if you are using custom levels, or
776      if the default algorithm is not suitable for your needs. The
777      default algorithm maps ``DEBUG``, ``INFO``, ``WARNING``, ``ERROR`` and
778      ``CRITICAL`` to the equivalent syslog names, and all other level
779      names to 'warning'.
780
781.. _nt-eventlog-handler:
782
783NTEventLogHandler
784^^^^^^^^^^^^^^^^^
785
786The :class:`NTEventLogHandler` class, located in the :mod:`logging.handlers`
787module, supports sending logging messages to a local Windows NT, Windows 2000 or
788Windows XP event log. Before you can use it, you need Mark Hammond's Win32
789extensions for Python installed.
790
791
792.. class:: NTEventLogHandler(appname, dllname=None, logtype='Application')
793
794   Returns a new instance of the :class:`NTEventLogHandler` class. The *appname* is
795   used to define the application name as it appears in the event log. An
796   appropriate registry entry is created using this name. The *dllname* should give
797   the fully qualified pathname of a .dll or .exe which contains message
798   definitions to hold in the log (if not specified, ``'win32service.pyd'`` is used
799   - this is installed with the Win32 extensions and contains some basic
800   placeholder message definitions. Note that use of these placeholders will make
801   your event logs big, as the entire message source is held in the log. If you
802   want slimmer logs, you have to pass in the name of your own .dll or .exe which
803   contains the message definitions you want to use in the event log). The
804   *logtype* is one of ``'Application'``, ``'System'`` or ``'Security'``, and
805   defaults to ``'Application'``.
806
807
808   .. method:: close()
809
810      At this point, you can remove the application name from the registry as a
811      source of event log entries. However, if you do this, you will not be able
812      to see the events as you intended in the Event Log Viewer - it needs to be
813      able to access the registry to get the .dll name. The current version does
814      not do this.
815
816
817   .. method:: emit(record)
818
819      Determines the message ID, event category and event type, and then logs
820      the message in the NT event log.
821
822
823   .. method:: getEventCategory(record)
824
825      Returns the event category for the record. Override this if you want to
826      specify your own categories. This version returns 0.
827
828
829   .. method:: getEventType(record)
830
831      Returns the event type for the record. Override this if you want to
832      specify your own types. This version does a mapping using the handler's
833      typemap attribute, which is set up in :meth:`__init__` to a dictionary
834      which contains mappings for :const:`DEBUG`, :const:`INFO`,
835      :const:`WARNING`, :const:`ERROR` and :const:`CRITICAL`. If you are using
836      your own levels, you will either need to override this method or place a
837      suitable dictionary in the handler's *typemap* attribute.
838
839
840   .. method:: getMessageID(record)
841
842      Returns the message ID for the record. If you are using your own messages,
843      you could do this by having the *msg* passed to the logger being an ID
844      rather than a format string. Then, in here, you could use a dictionary
845      lookup to get the message ID. This version returns 1, which is the base
846      message ID in :file:`win32service.pyd`.
847
848.. _smtp-handler:
849
850SMTPHandler
851^^^^^^^^^^^
852
853The :class:`SMTPHandler` class, located in the :mod:`logging.handlers` module,
854supports sending logging messages to an email address via SMTP.
855
856
857.. class:: SMTPHandler(mailhost, fromaddr, toaddrs, subject, credentials=None, secure=None, timeout=1.0)
858
859   Returns a new instance of the :class:`SMTPHandler` class. The instance is
860   initialized with the from and to addresses and subject line of the email. The
861   *toaddrs* should be a list of strings. To specify a non-standard SMTP port, use
862   the (host, port) tuple format for the *mailhost* argument. If you use a string,
863   the standard SMTP port is used. If your SMTP server requires authentication, you
864   can specify a (username, password) tuple for the *credentials* argument.
865
866   To specify the use of a secure protocol (TLS), pass in a tuple to the
867   *secure* argument. This will only be used when authentication credentials are
868   supplied. The tuple should be either an empty tuple, or a single-value tuple
869   with the name of a keyfile, or a 2-value tuple with the names of the keyfile
870   and certificate file. (This tuple is passed to the
871   :meth:`smtplib.SMTP.starttls` method.)
872
873   A timeout can be specified for communication with the SMTP server using the
874   *timeout* argument.
875
876   .. versionadded:: 3.3
877      The *timeout* argument was added.
878
879   .. method:: emit(record)
880
881      Formats the record and sends it to the specified addressees.
882
883
884   .. method:: getSubject(record)
885
886      If you want to specify a subject line which is record-dependent, override
887      this method.
888
889.. _memory-handler:
890
891MemoryHandler
892^^^^^^^^^^^^^
893
894The :class:`MemoryHandler` class, located in the :mod:`logging.handlers` module,
895supports buffering of logging records in memory, periodically flushing them to a
896:dfn:`target` handler. Flushing occurs whenever the buffer is full, or when an
897event of a certain severity or greater is seen.
898
899:class:`MemoryHandler` is a subclass of the more general
900:class:`BufferingHandler`, which is an abstract class. This buffers logging
901records in memory. Whenever each record is added to the buffer, a check is made
902by calling :meth:`shouldFlush` to see if the buffer should be flushed.  If it
903should, then :meth:`flush` is expected to do the flushing.
904
905
906.. class:: BufferingHandler(capacity)
907
908   Initializes the handler with a buffer of the specified capacity. Here,
909   *capacity* means the number of logging records buffered.
910
911
912   .. method:: emit(record)
913
914      Append the record to the buffer. If :meth:`shouldFlush` returns true,
915      call :meth:`flush` to process the buffer.
916
917
918   .. method:: flush()
919
920      You can override this to implement custom flushing behavior. This version
921      just zaps the buffer to empty.
922
923
924   .. method:: shouldFlush(record)
925
926      Return ``True`` if the buffer is up to capacity. This method can be
927      overridden to implement custom flushing strategies.
928
929
930.. class:: MemoryHandler(capacity, flushLevel=ERROR, target=None, flushOnClose=True)
931
932   Returns a new instance of the :class:`MemoryHandler` class. The instance is
933   initialized with a buffer size of *capacity* (number of records buffered).
934   If *flushLevel* is not specified, :const:`ERROR` is used. If no *target* is
935   specified, the target will need to be set using :meth:`setTarget` before this
936   handler does anything useful. If *flushOnClose* is specified as ``False``,
937   then the buffer is *not* flushed when the handler is closed. If not specified
938   or specified as ``True``, the previous behaviour of flushing the buffer will
939   occur when the handler is closed.
940
941   .. versionchanged:: 3.6
942      The *flushOnClose* parameter was added.
943
944
945   .. method:: close()
946
947      Calls :meth:`flush`, sets the target to ``None`` and clears the
948      buffer.
949
950
951   .. method:: flush()
952
953      For a :class:`MemoryHandler`, flushing means just sending the buffered
954      records to the target, if there is one. The buffer is also cleared when
955      this happens. Override if you want different behavior.
956
957
958   .. method:: setTarget(target)
959
960      Sets the target handler for this handler.
961
962
963   .. method:: shouldFlush(record)
964
965      Checks for buffer full or a record at the *flushLevel* or higher.
966
967
968.. _http-handler:
969
970HTTPHandler
971^^^^^^^^^^^
972
973The :class:`HTTPHandler` class, located in the :mod:`logging.handlers` module,
974supports sending logging messages to a web server, using either ``GET`` or
975``POST`` semantics.
976
977
978.. class:: HTTPHandler(host, url, method='GET', secure=False, credentials=None, context=None)
979
980   Returns a new instance of the :class:`HTTPHandler` class. The *host* can be
981   of the form ``host:port``, should you need to use a specific port number.  If
982   no *method* is specified, ``GET`` is used. If *secure* is true, a HTTPS
983   connection will be used. The *context* parameter may be set to a
984   :class:`ssl.SSLContext` instance to configure the SSL settings used for the
985   HTTPS connection. If *credentials* is specified, it should be a 2-tuple
986   consisting of userid and password, which will be placed in a HTTP
987   'Authorization' header using Basic authentication. If you specify
988   credentials, you should also specify secure=True so that your userid and
989   password are not passed in cleartext across the wire.
990
991   .. versionchanged:: 3.5
992      The *context* parameter was added.
993
994   .. method:: mapLogRecord(record)
995
996      Provides a dictionary, based on ``record``, which is to be URL-encoded
997      and sent to the web server. The default implementation just returns
998      ``record.__dict__``. This method can be overridden if e.g. only a
999      subset of :class:`~logging.LogRecord` is to be sent to the web server, or
1000      if more specific customization of what's sent to the server is required.
1001
1002   .. method:: emit(record)
1003
1004      Sends the record to the web server as a URL-encoded dictionary. The
1005      :meth:`mapLogRecord` method is used to convert the record to the
1006      dictionary to be sent.
1007
1008   .. note:: Since preparing a record for sending it to a web server is not
1009      the same as a generic formatting operation, using
1010      :meth:`~logging.Handler.setFormatter` to specify a
1011      :class:`~logging.Formatter` for a :class:`HTTPHandler` has no effect.
1012      Instead of calling :meth:`~logging.Handler.format`, this handler calls
1013      :meth:`mapLogRecord` and then :func:`urllib.parse.urlencode` to encode the
1014      dictionary in a form suitable for sending to a web server.
1015
1016
1017.. _queue-handler:
1018
1019
1020QueueHandler
1021^^^^^^^^^^^^
1022
1023.. versionadded:: 3.2
1024
1025The :class:`QueueHandler` class, located in the :mod:`logging.handlers` module,
1026supports sending logging messages to a queue, such as those implemented in the
1027:mod:`queue` or :mod:`multiprocessing` modules.
1028
1029Along with the :class:`QueueListener` class, :class:`QueueHandler` can be used
1030to let handlers do their work on a separate thread from the one which does the
1031logging. This is important in web applications and also other service
1032applications where threads servicing clients need to respond as quickly as
1033possible, while any potentially slow operations (such as sending an email via
1034:class:`SMTPHandler`) are done on a separate thread.
1035
1036.. class:: QueueHandler(queue)
1037
1038   Returns a new instance of the :class:`QueueHandler` class. The instance is
1039   initialized with the queue to send messages to. The *queue* can be any
1040   queue-like object; it's used as-is by the :meth:`enqueue` method, which
1041   needs to know how to send messages to it. The queue is not *required* to
1042   have the task tracking API, which means that you can use
1043   :class:`~queue.SimpleQueue` instances for *queue*.
1044
1045   .. note:: If you are using :mod:`multiprocessing`, you should avoid using
1046      :class:`~queue.SimpleQueue` and instead use :class:`multiprocessing.Queue`.
1047
1048   .. method:: emit(record)
1049
1050      Enqueues the result of preparing the LogRecord. Should an exception
1051      occur (e.g. because a bounded queue has filled up), the
1052      :meth:`~logging.Handler.handleError` method is called to handle the
1053      error. This can result in the record silently being dropped (if
1054      :attr:`logging.raiseExceptions` is ``False``) or a message printed to
1055      ``sys.stderr`` (if :attr:`logging.raiseExceptions` is ``True``).
1056
1057   .. method:: prepare(record)
1058
1059      Prepares a record for queuing. The object returned by this
1060      method is enqueued.
1061
1062      The base implementation formats the record to merge the message,
1063      arguments, exception and stack information, if present.  It also removes
1064      unpickleable items from the record in-place. Specifically, it overwrites
1065      the record's :attr:`msg` and :attr:`message` attributes with the merged
1066      message (obtained by calling the handler's :meth:`format` method), and
1067      sets the :attr:`args`, :attr:`exc_info` and :attr:`exc_text` attributes
1068      to ``None``.
1069
1070      You might want to override this method if you want to convert
1071      the record to a dict or JSON string, or send a modified copy
1072      of the record while leaving the original intact.
1073
1074      .. note:: The base implementation formats the message with arguments, sets
1075         the ``message`` and ``msg`` attributes to the formatted message and
1076         sets the ``args`` and ``exc_text`` attributes to ``None`` to allow
1077         pickling and to prevent further attempts at formatting. This means
1078         that a handler on the :class:`QueueListener` side won't have the
1079         information to do custom formatting, e.g. of exceptions. You may wish
1080         to subclass ``QueueHandler`` and override this method to e.g. avoid
1081         setting ``exc_text`` to ``None``. Note that the ``message`` / ``msg``
1082         / ``args`` changes are related to ensuring the record is pickleable,
1083         and you might or might not be able to avoid doing that depending on
1084         whether your ``args`` are pickleable. (Note that you may have to
1085         consider not only your own code but also code in any libraries that
1086         you use.)
1087
1088   .. method:: enqueue(record)
1089
1090      Enqueues the record on the queue using ``put_nowait()``; you may
1091      want to override this if you want to use blocking behaviour, or a
1092      timeout, or a customized queue implementation.
1093
1094
1095
1096.. _queue-listener:
1097
1098QueueListener
1099^^^^^^^^^^^^^
1100
1101.. versionadded:: 3.2
1102
1103The :class:`QueueListener` class, located in the :mod:`logging.handlers`
1104module, supports receiving logging messages from a queue, such as those
1105implemented in the :mod:`queue` or :mod:`multiprocessing` modules. The
1106messages are received from a queue in an internal thread and passed, on
1107the same thread, to one or more handlers for processing. While
1108:class:`QueueListener` is not itself a handler, it is documented here
1109because it works hand-in-hand with :class:`QueueHandler`.
1110
1111Along with the :class:`QueueHandler` class, :class:`QueueListener` can be used
1112to let handlers do their work on a separate thread from the one which does the
1113logging. This is important in web applications and also other service
1114applications where threads servicing clients need to respond as quickly as
1115possible, while any potentially slow operations (such as sending an email via
1116:class:`SMTPHandler`) are done on a separate thread.
1117
1118.. class:: QueueListener(queue, *handlers, respect_handler_level=False)
1119
1120   Returns a new instance of the :class:`QueueListener` class. The instance is
1121   initialized with the queue to send messages to and a list of handlers which
1122   will handle entries placed on the queue. The queue can be any queue-like
1123   object; it's passed as-is to the :meth:`dequeue` method, which needs
1124   to know how to get messages from it. The queue is not *required* to have the
1125   task tracking API (though it's used if available), which means that you can
1126   use :class:`~queue.SimpleQueue` instances for *queue*.
1127
1128   .. note:: If you are using :mod:`multiprocessing`, you should avoid using
1129      :class:`~queue.SimpleQueue` and instead use :class:`multiprocessing.Queue`.
1130
1131   If ``respect_handler_level`` is ``True``, a handler's level is respected
1132   (compared with the level for the message) when deciding whether to pass
1133   messages to that handler; otherwise, the behaviour is as in previous Python
1134   versions - to always pass each message to each handler.
1135
1136   .. versionchanged:: 3.5
1137      The ``respect_handler_level`` argument was added.
1138
1139   .. method:: dequeue(block)
1140
1141      Dequeues a record and return it, optionally blocking.
1142
1143      The base implementation uses ``get()``. You may want to override this
1144      method if you want to use timeouts or work with custom queue
1145      implementations.
1146
1147   .. method:: prepare(record)
1148
1149      Prepare a record for handling.
1150
1151      This implementation just returns the passed-in record. You may want to
1152      override this method if you need to do any custom marshalling or
1153      manipulation of the record before passing it to the handlers.
1154
1155   .. method:: handle(record)
1156
1157      Handle a record.
1158
1159      This just loops through the handlers offering them the record
1160      to handle. The actual object passed to the handlers is that which
1161      is returned from :meth:`prepare`.
1162
1163   .. method:: start()
1164
1165      Starts the listener.
1166
1167      This starts up a background thread to monitor the queue for
1168      LogRecords to process.
1169
1170   .. method:: stop()
1171
1172      Stops the listener.
1173
1174      This asks the thread to terminate, and then waits for it to do so.
1175      Note that if you don't call this before your application exits, there
1176      may be some records still left on the queue, which won't be processed.
1177
1178   .. method:: enqueue_sentinel()
1179
1180      Writes a sentinel to the queue to tell the listener to quit. This
1181      implementation uses ``put_nowait()``.  You may want to override this
1182      method if you want to use timeouts or work with custom queue
1183      implementations.
1184
1185      .. versionadded:: 3.3
1186
1187
1188.. seealso::
1189
1190   Module :mod:`logging`
1191      API reference for the logging module.
1192
1193   Module :mod:`logging.config`
1194      Configuration API for the logging module.
1195
1196
1197