Codeintel does not work in IDE 8.5.3

chris · May 8, 2014, 1:28pm

Ever since I “upgraded” to version 8.5 I’ve had codeintel problems. I went back to 8.0.2 for a while hoping the problems would all get taken care of. Today I thought I would try the latest 8.5.3 again, but it still isn’t working. What I need working most of all is the Goto Definition functionality. I’ve spent hours and hours trying to get this to work without any success. Any assistance would be appreciated.

The “komodo.exe” process is using 181 MB of memory. My system still has 7.6 GB free.

Here is the contents of the log file:

[2014-05-08 15:07:57,210] [DEBUG] places_js: waiting for document complete
[2014-05-08 15:07:57,578] [ERROR] koPHPLinter: Error getting phpInfoEx.version.  Is a PHP interpreter defined?
[2014-05-08 15:09:40,576] [WARNING] codeintel.db: the following catalog selections didn't match any loaded API catalog: 'pywin32 (Python3)'
[2014-05-08 15:10:04,473] [ERROR] codeintel.tree: Unexpected error with evaluator: 'Survey.loadModel' at reportcontroller.php#41
Traceback (most recent call last):
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree.py", line 295, in eval
    defns = self.eval_defns()
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 315, in eval_defns
    hit = self._hit_from_citdl(self.expr, start_scoperef, defn_only=True)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 786, in _hit_from_citdl
    hits, nconsumed = self._hits_from_first_part(tokens, scoperef)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1120, in _hits_from_first_part
    hit, nconsumed = self._hit_from_elem_imports(tokens, elem)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1172, in _hit_from_elem_imports
    tokens, blob, (blob, []))
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1301, in _hit_from_getattr
    hit, nconsumed = self._hit_from_elem_imports(tokens, elem)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1172, in _hit_from_elem_imports
    tokens, blob, (blob, []))
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1301, in _hit_from_getattr
    hit, nconsumed = self._hit_from_elem_imports(tokens, elem)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1197, in _hit_from_elem_imports
    curr_buf=self.buf)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\multilanglib.py", line 129, in hits_from_lpath
    self.ensure_all_dirs_scanned(ctlr=ctlr)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\langlibbase.py", line 64, in ensure_all_dirs_scanned
    self.ensure_dir_scanned(dir, ctlr=ctlr, reporter=lambda msg: None)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\langlibbase.py", line 106, in ensure_dir_scanned
    buf.scan_if_necessary()
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\citadel.py", line 355, in scan_if_necessary
    self.blob_from_lang
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\citadel.py", line 205, in blob_from_lang
    self._load_buf_data_once(True)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\citadel.py", line 139, in _load_buf_data_once
    self._blob_from_lang_cache = self.mgr.db.get_buf_data(self)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\database.py", line 1032, in get_buf_data
    return self._get_lang_zone(buf.lang).get_buf_data(buf)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\multilanglib.py", line 646, in get_buf_data
    blob = self.load_blob(dbsubpath)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\langlib.py", line 1109, in load_blob
    blob = ET.parse(dbpath).getroot()
  File "<string>", line 45, in parse
  File "<string>", line 32, in parse
MemoryError
[2014-05-08 15:10:04,490] [ERROR] codeintel.tree: Unexpected error with evaluator: 'Survey.loadModel' at reportcontroller.php#41
Traceback (most recent call last):
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree.py", line 295, in eval
    defns = self.eval_defns()
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 315, in eval_defns
    hit = self._hit_from_citdl(self.expr, start_scoperef, defn_only=True)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 786, in _hit_from_citdl
    hits, nconsumed = self._hits_from_first_part(tokens, scoperef)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1120, in _hits_from_first_part
    hit, nconsumed = self._hit_from_elem_imports(tokens, elem)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1163, in _hit_from_elem_imports
    module_name, libs, self.ctlr)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\citadel.py", line 586, in import_blob_name
    blob = lib.get_blob(import_name)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\multilanglib.py", line 97, in get_blob
    return self.lang_zone.load_blob(dbsubpath)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\langlib.py", line 1109, in load_blob
    blob = ET.parse(dbpath).getroot()
  File "<string>", line 45, in parse
  File "<string>", line 32, in parse
MemoryError
[2014-05-08 15:10:14,039] [ERROR] codeintel.tree: Unexpected error with evaluator: 'FilterContainer.listFilterContainers' at reportcontroller.php#53
Traceback (most recent call last):
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree.py", line 295, in eval
    defns = self.eval_defns()
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 315, in eval_defns
    hit = self._hit_from_citdl(self.expr, start_scoperef, defn_only=True)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 786, in _hit_from_citdl
    hits, nconsumed = self._hits_from_first_part(tokens, scoperef)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1120, in _hits_from_first_part
    hit, nconsumed = self._hit_from_elem_imports(tokens, elem)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1172, in _hit_from_elem_imports
    tokens, blob, (blob, []))
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1301, in _hit_from_getattr
    hit, nconsumed = self._hit_from_elem_imports(tokens, elem)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1172, in _hit_from_elem_imports
    tokens, blob, (blob, []))
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1301, in _hit_from_getattr
    hit, nconsumed = self._hit_from_elem_imports(tokens, elem)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\tree_php.py", line 1197, in _hit_from_elem_imports
    curr_buf=self.buf)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\multilanglib.py", line 129, in hits_from_lpath
    self.ensure_all_dirs_scanned(ctlr=ctlr)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\langlibbase.py", line 64, in ensure_all_dirs_scanned
    self.ensure_dir_scanned(dir, ctlr=ctlr, reporter=lambda msg: None)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\database\langlibbase.py", line 106, in ensure_dir_scanned
    buf.scan_if_necessary()
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\citadel.py", line 355, in scan_if_necessary
    self.blob_from_lang
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\citadel.py", line 202, in blob_from_lang
    self.scan()
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\udl.py", line 485, in scan
    self.xml_parse() # force reparse of XML
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\udl.py", line 521, in xml_parse
    for offset, text in self.text_chunks_from_lang(self.m_lang):
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\udl.py", line 273, in text_chunks_from_lang
    for token in self.accessor.gen_tokens():
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\accessor.py", line 277, in gen_tokens
    for token in self.tokens:
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\accessor.py", line 130, in tokens
    self.__tokens_cache = self.lexer.tokenize_by_style(self.content)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\udl.py", line 99, in tokenize_by_style
    return Lexer.tokenize_by_style(self, text, call_back)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\SilverCity\Lexer.py", line 14, in tokenize_by_style
    self._properties
MemoryError
[2014-05-08 15:10:15,897] [ERROR] codeintel.oop.driver: 
Traceback (most recent call last):
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\oop\driver.py", line 518, in run
    handler.handleRequest(request, self)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\oop\driver.py", line 576, in handleRequest
    meth(request, driver)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\oop\driver.py", line 806, in do_trg_from_pos
    trg = buf.defn_trg_from_pos(pos, lang=None)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\udl.py", line 366, in defn_trg_from_pos
    lang=self.lang_from_pos(pos))
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\udl.py", line 218, in lang_from_pos
    style = self.accessor.style_at_pos(pos)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\accessor.py", line 175, in style_at_pos
    return self._token_at_pos(pos)["style"]
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\accessor.py", line 153, in _token_at_pos
    lower, upper = 0, len(self.tokens)  # [lower-limit, upper-limit)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\accessor.py", line 130, in tokens
    self.__tokens_cache = self.lexer.tokenize_by_style(self.content)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\codeintel2\udl.py", line 99, in tokenize_by_style
    return Lexer.tokenize_by_style(self, text, call_back)
  File "C:\Program Files (x86)\ActiveState Komodo IDE 8\lib\mozilla\python\komodo\SilverCity\Lexer.py", line 14, in tokenize_by_style
    self._properties
MemoryError

nathanr · May 8, 2014, 4:04pm

Could you see if the latest nightly resolves your issue?

http://komodoide.com/framed/?http://downloads.activestate.com/Komodo/nightly/

chris · May 8, 2014, 4:32pm

Nathan, in that link I only see versions for OSX and Linux or am I missing something?

Defman · May 8, 2014, 4:36pm

You need a *.msi file (MicroSoft installer)
Download

chris · May 8, 2014, 5:32pm

That’s the link for Edit. Do you also have one for the IDE?

Defman · May 8, 2014, 5:33pm

I think Komodo Developers not create a nightly version of Komodo IDE for Windows.

chris · May 8, 2014, 5:46pm

Is there anything newer than 8.5.3? It would be nice if there was at least one working version after 8.0.2.

nathanr · May 8, 2014, 6:11pm

Here’s the latest nightly that includes a windows build: http://downloads.activestate.com/Komodo/nightly/komodoide/2014/05/2014-05-01-00-8.5.4/

alvaro · May 8, 2014, 6:43pm

They actually do. But either the system is manual, or the build process breaks now and them.

nathanr · May 8, 2014, 6:48pm

I believe the build system fails every now and then - these are nightlies after all.

chris · May 9, 2014, 11:01am

Thanks. That build works better, but it still takes 10-20 seconds before the jump occurs, which can be a bit annoying while trying to code. I also see errors in the log file:

[2014-05-09 12:24:27,859] [ERROR] codeintel.oop.driver: list index out of range
Traceback (most recent call last):
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\oop\driver.py”, line 518, in run
handler.handleRequest(request, self)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\components\codeBrowserOOP.py”, line 25, in handleRequest
return meth(request, driver)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\components\codeBrowserOOP.py”, line 125, in do_locate_scope
blob, lpath = buf.scoperef_from_pos(pos) or (None, None)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\udl.py”, line 304, in scoperef_from_pos
lang = self.lang_from_pos(pos)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\udl.py”, line 218, in lang_from_pos
style = self.accessor.style_at_pos(pos)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\accessor.py”, line 175, in style_at_pos
return self._token_at_pos(pos)[“style”]
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\accessor.py”, line 159, in _token_at_pos
token = self.tokens[idx]
IndexError: list index out of range
[2014-05-09 12:24:55,052] [ERROR] codeintel.oop.driver: list index out of range
Traceback (most recent call last):
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\oop\driver.py”, line 518, in run
handler.handleRequest(request, self)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\components\codeBrowserOOP.py”, line 25, in handleRequest
return meth(request, driver)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\components\codeBrowserOOP.py”, line 125, in do_locate_scope
blob, lpath = buf.scoperef_from_pos(pos) or (None, None)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\udl.py”, line 304, in scoperef_from_pos
lang = self.lang_from_pos(pos)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\udl.py”, line 218, in lang_from_pos
style = self.accessor.style_at_pos(pos)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\accessor.py”, line 175, in style_at_pos
return self._token_at_pos(pos)[“style”]
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\accessor.py”, line 159, in _token_at_pos
token = self.tokens[idx]
IndexError: list index out of range
[2014-05-09 12:57:07,233] [ERROR] codeintel.oop.driver: list index out of range
Traceback (most recent call last):
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\oop\driver.py”, line 518, in run
handler.handleRequest(request, self)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\components\codeBrowserOOP.py”, line 25, in handleRequest
return meth(request, driver)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\components\codeBrowserOOP.py”, line 125, in do_locate_scope
blob, lpath = buf.scoperef_from_pos(pos) or (None, None)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\udl.py”, line 304, in scoperef_from_pos
lang = self.lang_from_pos(pos)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\udl.py”, line 218, in lang_from_pos
style = self.accessor.style_at_pos(pos)
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\accessor.py”, line 175, in style_at_pos
return self._token_at_pos(pos)[“style”]
File “C:\Program Files (x86)\ActiveState Komodo IDE 8 nightly\lib\mozilla\python\komodo\codeintel2\accessor.py”, line 159, in _token_at_pos
token = self.tokens[idx]
IndexError: list index out of range

Defman · May 9, 2014, 2:04pm

Can you install Komodo Edit to path without spaces? (e.g. C:\KomodoEdit). I don’t know can this help, but try

nathanr · May 9, 2014, 3:55pm

This will not make any difference, Komodo fully supports paths with spaces in them.

Alright but the main problem is at least fixed. As for the 10-20 seconds it takes to jump to definition - I am guessing you are working in fairly large project? Would you be able to exclude certain subdirectories from your project to make code intelligence faster? I’ve never encountered a use-case where it took 10 seconds to go to definition, but it can be a bit slow on larger projects sometimes. We are working on improvements in this area for Komodo 9.

chris · May 10, 2014, 1:47pm

Thanks for the assistance, but I’m moving over to PhpStorm. I can’t afford to spend any more hours just trying to get this to work.

nathanr · May 10, 2014, 3:46pm

Sorry to hear that. I will note that edge-cases like this can occur in any software, sorry you had to be the one to run into it.

nathanr · September 1, 2014, 4:03pm

I moved 2 posts to a new topic: CodeIntel Improvements