NOC

  • Log In Access more options
    • Online Help
    • GreenHopper Help
    • Agile Answers
    • Use Agile By Default
    • Keyboard Shortcuts
    • About JIRA
    • JIRA Credits
    • What’s New
    • Get Bonfire Extension
  • Dashboards Access more options (Alt+d)
  • Projects Access more options (Alt+p)
  • Issues Access more options (Alt+i)
  • Agile Access more options
    • Planning Board
    • Task Board
    • Chart Board
    • Released Board
    • Rapid Board
    • Manage Rapid Boards
    • Getting Started
  • NOC
  • NOC-372

кончатется память

  • Rapid Board
  • More Actions
  • Views
    • XML
    • Word
    • Printable

Details

  • Type: Bug Bug
  • Status: Reopened Reopened
  • Priority: Critical Critical
  • Resolution: Unresolved
  • Affects Version/s: None
  • Fix Version/s: None
  • Component/s: None
  • Labels:
    None
  • Difficulty:
    Medium

Description

между r5459 и r5757 что то пошло не так.

активаторы съедают все. если убить активатор лог утверждает что активатор собирал аликов. штук эдак по 30 на активатор.

  • Options
    • Sort By Name
    • Sort By Date
    • Ascending
    • Descending
    • Download All

Attachments

  1. chart2.png
    53 kB
    21.02.2012 03:01

Activity

Ascending order - Click to sort in descending order
  • All
  • Comments
  • Work Log
  • History
  • Activity
Hide
Permalink
Aleksey Shirokih added a comment - 21.02.2012 07:46
==> /var/log/noc/noc-activator.3.log <==
2012-02-21 13:45:27,108 STATS:
2012-02-21 13:45:27,108 factory.sockets: 1
2012-02-21 13:45:27,108 rpc.requests: 777
2012-02-21 13:45:27,109 rpc.responses: 5
2012-02-21 13:45:27,109 rpc.errors: 0
2012-02-21 13:45:49,096 EXECUTION FRAME REPORT (2012-02-21 13:45:49.048449)
Working directory: /opt/noc
START OF TRACEBACK
------------------------------------------------------------------------
File: /opt/noc/lib/nbsocket/socketfactory.py (Line: 391)
Function: get_active_epoll
  384                 for f, s in self.sockets.items():
  385                     e = ((select.EPOLLIN if s.can_read() else 0) |
  386                          (select.EPOLLOUT if s.can_write() else 0))
  387                     if e:
  388                         epoll.register(f, e)
  389             # Poll socket status
  390             try:
  391 ==>             events = epoll.poll(timeout)
  392             except select.error, why:
  393                 if why[0] not in (EINTR, EBADF):
  394                     error_report()  # non-ignorable errors
  395                 return [], []
  396             except:
  397                 return [], []
Variables:
                   e = 1
               epoll = <select.epoll object at 0x24bb5b8>
                self = <noc.lib.nbsocket.socketfactory.SocketFactory object at 0x2089790>
                   f = 11
                   s = <noc.sa.activator.activator_socket.ActivatorSocket object at 0x24848d0>
             timeout = 1
------------------------------------------------------------------------
File: /opt/noc/lib/nbsocket/socketfactory.py (Line: 271)
Function: loop
  264         def loop(self, timeout=1):
  265             """
  266             Generic event loop. Depends upon get_active_sockets() method, set
  267             up by factory constructor
  268             """
  269             self.create_pending_sockets()
  270             if self.sockets:
  271 ==>             r, w = self.get_active_sockets(timeout)
  272                 self.cnt_polls += 1
  273                 #logging.debug("Active sockets: Read=%s Write=%s"%(repr(r), repr(w)))
  274                 # Process write events before read to catch refused connections
  275                 for fd in w:
  276                     s = self.sockets.get(fd)
  277                     if s:
Variables:
                self = <noc.lib.nbsocket.socketfactory.SocketFactory object at 0x2089790>
             timeout = 1
------------------------------------------------------------------------
File: /opt/noc/lib/nbsocket/socketfactory.py (Line: 421)
Function: run
  414             else:
  415                 cond = lambda: len(self.sockets) > 0
  416                 # Wait for any socket
  417                 while not cond():
  418                     time.sleep(1)
  419             last_tick = last_stale = time.time()
  420             while cond() and not self.to_shutdown:
  421 ==>             self.loop(1)
  422                 t = time.time()
  423                 if self.tick_callback and t - last_tick >= 1:
  424                     try:
  425                         self.tick_callback()
  426                     except:
  427                         error_report()
Variables:
                self = <noc.lib.nbsocket.socketfactory.SocketFactory object at 0x2089790>
                cond = <function <lambda> at 0x23da938>
                   t = 1329810348.1081121
          last_stale = 1329810348.1081121
         run_forever = True
           last_tick = 1329810347.1081271
------------------------------------------------------------------------
File: /opt/noc/sa/activator/activator.py (Line: 445)
Function: run
  438         def check_event_source(self, address):
  439             return address in self.event_sources
  440     
  441         def run(self):
  442             """
  443             Main event loop
  444             """
  445 ==>         self.factory.run(run_forever=True)
  446     
  447         def tick(self):
  448             """
  449             Called every second
  450             """
  451             t = time.time()
Variables:
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
------------------------------------------------------------------------
File: /opt/noc/lib/daemon.py (Line: 326)
Function: guarded_run
  319     
  320         def guarded_run(self):
  321             """
  322             Run daemon and catch common exceptions
  323             :return:
  324             """
  325             try:
  326 ==>             self.run()
  327             except KeyboardInterrupt:
  328                 pass
  329             except MemoryError:
  330                 logging.error("Out of memory. Exiting.")
  331             except:
  332                 error_report()
Variables:
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
------------------------------------------------------------------------
File: /opt/noc/lib/daemon.py (Line: 377)
Function: launch
  370             o = open("/dev/null", "a+")
  371             e = open("/dev/null", "a+")
  372             os.dup2(i.fileno(), sys.stdin.fileno())
  373             os.dup2(o.fileno(), sys.stdout.fileno())
  374             os.dup2(e.fileno(), sys.stderr.fileno())
  375             sys.stdout = o
  376             sys.stderr = e
  377 ==>         self.guarded_run()
  378     
  379         def refresh(self):
  380             """
  381             "refresh" command handler
  382             :return:
  383             """
Variables:
                   i = <open file '/dev/null', mode 'r' at 0x230ef60>
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
                   e = <open file '/dev/null', mode 'a+' at 0x24890c0>
                   o = <open file '/dev/null', mode 'a+' at 0x2489030>
------------------------------------------------------------------------
File: /opt/noc/lib/daemon.py (Line: 318)
Function: process_command
  311             pass
  312     
  313         def process_command(self):
  314             """
  315             Process self.args[0] command
  316             :return:
  317             """
  318 ==>         getattr(self, self.args[0])()
  319     
  320         def guarded_run(self):
  321             """
  322             Run daemon and catch common exceptions
  323             :return:
  324             """
Variables:
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
------------------------------------------------------------------------
File: ./scripts/noc-activator.py (Line: 18)
Function: <module>
   11     import set_env
   12     
   13     set_env.setup(use_django=True)
   14     
   15     if __name__ == "__main__":
   16         # Run activator
   17         from noc.sa.activator import Activator
   18 ==>     Activator().process_command()

Variables:
             set_env = <module 'set_env' from '/opt/noc/scripts/set_env.pyc'>
        __builtins__ = <module '__builtin__' (built-in)>
            __file__ = './scripts/noc-activator.py'
         __package__ = None
           Activator = <class 'noc.sa.activator.activator.Activator'>
            __name__ = '__main__'
             __doc__ = None
------------------------------------------------------------------------
END OF TRACEBACK
Show
Aleksey Shirokih added a comment - 21.02.2012 07:46
==> /var/log/noc/noc-activator.3.log <==
2012-02-21 13:45:27,108 STATS:
2012-02-21 13:45:27,108 factory.sockets: 1
2012-02-21 13:45:27,108 rpc.requests: 777
2012-02-21 13:45:27,109 rpc.responses: 5
2012-02-21 13:45:27,109 rpc.errors: 0
2012-02-21 13:45:49,096 EXECUTION FRAME REPORT (2012-02-21 13:45:49.048449)
Working directory: /opt/noc
START OF TRACEBACK
------------------------------------------------------------------------
File: /opt/noc/lib/nbsocket/socketfactory.py (Line: 391)
Function: get_active_epoll
  384                 for f, s in self.sockets.items():
  385                     e = ((select.EPOLLIN if s.can_read() else 0) |
  386                          (select.EPOLLOUT if s.can_write() else 0))
  387                     if e:
  388                         epoll.register(f, e)
  389             # Poll socket status
  390             try:
  391 ==>             events = epoll.poll(timeout)
  392             except select.error, why:
  393                 if why[0] not in (EINTR, EBADF):
  394                     error_report()  # non-ignorable errors
  395                 return [], []
  396             except:
  397                 return [], []
Variables:
                   e = 1
               epoll = <select.epoll object at 0x24bb5b8>
                self = <noc.lib.nbsocket.socketfactory.SocketFactory object at 0x2089790>
                   f = 11
                   s = <noc.sa.activator.activator_socket.ActivatorSocket object at 0x24848d0>
             timeout = 1
------------------------------------------------------------------------
File: /opt/noc/lib/nbsocket/socketfactory.py (Line: 271)
Function: loop
  264         def loop(self, timeout=1):
  265             """
  266             Generic event loop. Depends upon get_active_sockets() method, set
  267             up by factory constructor
  268             """
  269             self.create_pending_sockets()
  270             if self.sockets:
  271 ==>             r, w = self.get_active_sockets(timeout)
  272                 self.cnt_polls += 1
  273                 #logging.debug("Active sockets: Read=%s Write=%s"%(repr(r), repr(w)))
  274                 # Process write events before read to catch refused connections
  275                 for fd in w:
  276                     s = self.sockets.get(fd)
  277                     if s:
Variables:
                self = <noc.lib.nbsocket.socketfactory.SocketFactory object at 0x2089790>
             timeout = 1
------------------------------------------------------------------------
File: /opt/noc/lib/nbsocket/socketfactory.py (Line: 421)
Function: run
  414             else:
  415                 cond = lambda: len(self.sockets) > 0
  416                 # Wait for any socket
  417                 while not cond():
  418                     time.sleep(1)
  419             last_tick = last_stale = time.time()
  420             while cond() and not self.to_shutdown:
  421 ==>             self.loop(1)
  422                 t = time.time()
  423                 if self.tick_callback and t - last_tick >= 1:
  424                     try:
  425                         self.tick_callback()
  426                     except:
  427                         error_report()
Variables:
                self = <noc.lib.nbsocket.socketfactory.SocketFactory object at 0x2089790>
                cond = <function <lambda> at 0x23da938>
                   t = 1329810348.1081121
          last_stale = 1329810348.1081121
         run_forever = True
           last_tick = 1329810347.1081271
------------------------------------------------------------------------
File: /opt/noc/sa/activator/activator.py (Line: 445)
Function: run
  438         def check_event_source(self, address):
  439             return address in self.event_sources
  440     
  441         def run(self):
  442             """
  443             Main event loop
  444             """
  445 ==>         self.factory.run(run_forever=True)
  446     
  447         def tick(self):
  448             """
  449             Called every second
  450             """
  451             t = time.time()
Variables:
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
------------------------------------------------------------------------
File: /opt/noc/lib/daemon.py (Line: 326)
Function: guarded_run
  319     
  320         def guarded_run(self):
  321             """
  322             Run daemon and catch common exceptions
  323             :return:
  324             """
  325             try:
  326 ==>             self.run()
  327             except KeyboardInterrupt:
  328                 pass
  329             except MemoryError:
  330                 logging.error("Out of memory. Exiting.")
  331             except:
  332                 error_report()
Variables:
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
------------------------------------------------------------------------
File: /opt/noc/lib/daemon.py (Line: 377)
Function: launch
  370             o = open("/dev/null", "a+")
  371             e = open("/dev/null", "a+")
  372             os.dup2(i.fileno(), sys.stdin.fileno())
  373             os.dup2(o.fileno(), sys.stdout.fileno())
  374             os.dup2(e.fileno(), sys.stderr.fileno())
  375             sys.stdout = o
  376             sys.stderr = e
  377 ==>         self.guarded_run()
  378     
  379         def refresh(self):
  380             """
  381             "refresh" command handler
  382             :return:
  383             """
Variables:
                   i = <open file '/dev/null', mode 'r' at 0x230ef60>
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
                   e = <open file '/dev/null', mode 'a+' at 0x24890c0>
                   o = <open file '/dev/null', mode 'a+' at 0x2489030>
------------------------------------------------------------------------
File: /opt/noc/lib/daemon.py (Line: 318)
Function: process_command
  311             pass
  312     
  313         def process_command(self):
  314             """
  315             Process self.args[0] command
  316             :return:
  317             """
  318 ==>         getattr(self, self.args[0])()
  319     
  320         def guarded_run(self):
  321             """
  322             Run daemon and catch common exceptions
  323             :return:
  324             """
Variables:
                self = <noc.sa.activator.activator.Activator object at 0x2089710>
------------------------------------------------------------------------
File: ./scripts/noc-activator.py (Line: 18)
Function: <module>
   11     import set_env
   12     
   13     set_env.setup(use_django=True)
   14     
   15     if __name__ == "__main__":
   16         # Run activator
   17         from noc.sa.activator import Activator
   18 ==>     Activator().process_command()

Variables:
             set_env = <module 'set_env' from '/opt/noc/scripts/set_env.pyc'>
        __builtins__ = <module '__builtin__' (built-in)>
            __file__ = './scripts/noc-activator.py'
         __package__ = None
           Activator = <class 'noc.sa.activator.activator.Activator'>
            __name__ = '__main__'
             __doc__ = None
------------------------------------------------------------------------
END OF TRACEBACK
Hide
Permalink
Aleksey Shirokih added a comment - 21.02.2012 15:12

починилось выставлением exit_command="logout"

Show
Aleksey Shirokih added a comment - 21.02.2012 15:12 починилось выставлением exit_command="logout"
Hide
Permalink
Aleksey Shirokih added a comment - 22.02.2012 02:34

нет не починилось

Show
Aleksey Shirokih added a comment - 22.02.2012 02:34 нет не починилось

People

  • Assignee:
    Dmitry Volodin
    Reporter:
    Aleksey Shirokih
Vote (0)
Watch (0)

Dates

  • Created:
    21.02.2012 03:01
    Updated:
    22.02.2012 02:34
  • Atlassian JIRA (v5.0.3#729-sha1:bf569e4)
  • Report a problem
  • Powered by a free Atlassian JIRA open source license for NOC Project. Try JIRA - bug tracking software for your team.