Latest Docker image is not working.

[PietFourie]

The latest docker image is not working.. (3 days ago). The previous version of 3.3.32 does not have this problem.
r2r_1 server

Log messages

ions

File "/usr/local/lib/python3.12/site-packages/lark/parsers/earley.py", line 19, in

from .grammar_analysis import GrammarAnalyzer

File "/usr/local/lib/python3.12/site-packages/lark/parsers/grammar_analysis.py", line 9, in

from ..common import ParserConf

File "/usr/local/lib/python3.12/site-packages/lark/common.py", line 60

self.ignore = ignore

                    ^

IndentationError: unindent does not match any outer indentation level

/usr/local/lib/python3.12/site-packages/pydantic/_internal/_config.py:345: UserWarning: Valid config keys have changed in V2:

• 'fields' has been removed

  warnings.warn(message, UserWarning)

Traceback (most recent call last):

File "/usr/local/bin/uvicorn", line 8, in

sys.exit(main())

         ^^^^^^

File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1161, in call

return self.main(*args, **kwargs)

       ^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1082, in main

rv = self.invoke(ctx)

     ^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/site-packages/click/core.py", line 1443, in invoke

return ctx.invoke(self.callback, **ctx.params)

       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/site-packages/click/core.py", line 788, in invoke

return __callback(*args, **kwargs)

       ^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/site-packages/uvicorn/main.py", line 418, in main

run(

File "/usr/local/lib/python3.12/site-packages/uvicorn/main.py", line 587, in run

server.run()

File "/usr/local/lib/python3.12/site-packages/uvicorn/server.py", line 62, in run

return asyncio.run(self.serve(sockets=sockets))

       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/asyncio/runners.py", line 194, in run

return runner.run(main)

       ^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/asyncio/runners.py", line 118, in run

return self._loop.run_until_complete(task)

       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/asyncio/base_events.py", line 686, in run_until_complete

return future.result()

       ^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/site-packages/uvicorn/server.py", line 69, in serve

config.load()

File "/usr/local/lib/python3.12/site-packages/uvicorn/config.py", line 458, in load

self.loaded_app = import_from_string(self.app)

                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/site-packages/uvicorn/importer.py", line 21, in import_from_string

module = importlib.import_module(module_str)

         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.12/importlib/init.py", line 90, in import_module

return _bootstrap._gcd_import(name[level:], package, level)

       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "", line 1387, in _gcd_import

File "", line 1360, in _find_and_load

File "", line 1310, in _find_and_load_unlocked

File "", line 488, in _call_with_frames_removed

File "", line 1387, in _gcd_import

File "", line 1360, in _find_and_load

File "", line 1310, in _find_and_load_unlocked

File "", line 488, in _call_with_frames_removed

File "", line 1387, in _gcd_import

File "", line 1360, in _find_and_load

File "", line 1331, in _find_and_load_unlocked

File "", line 935, in _load_unlocked

File "", line 999, in exec_module

File "", line 488, in _call_with_frames_removed

File "/app/core/init.py", line 6, in

from .main import *

File "/app/core/main/init.py", line 7, in

from .orchestration import *

File "/app/core/main/orchestration/init.py", line 1, in

from .hatchet.ingestion_workflow import hatchet_ingestion_factory

File "/app/core/main/orchestration/hatchet/ingestion_workflow.py", line 9, in

from hatchet_sdk import ConcurrencyLimitStrategy, Context

File "/usr/local/lib/python3.12/site-packages/hatchet_sdk/init.py", line 140, in

from .hatchet import ClientConfig, Hatchet, concurrency, on_failure_step, step, workflow

File "/usr/local/lib/python3.12/site-packages/hatchet_sdk/hatchet.py", line 20, in

from hatchet_sdk.rate_limit import RateLimit

File "/usr/local/lib/python3.12/site-packages/hatchet_sdk/rate_limit.py", line 4, in

from celpy import CELEvalError, Environment

File "/usr/local/lib/python3.12/site-packages/celpy/init.py", line 103, in

import lark

File "/usr/local/lib/python3.12/site-packages/lark/init.py", line 11, in

from .lark import Lark

File "/usr/local/lib/python3.12/site-packages/lark/lark.py", line 23, in

from .load_grammar import load_grammar, FromPackageLoader, Grammar, verify_used_files, PackageResource, sha256_digest

File "/usr/local/lib/python3.12/site-packages/lark/load_grammar.py", line 18, in

from .parser_frontends import ParsingFrontend

File "/usr/local/lib/python3.12/site-packages/lark/parser_frontends.py", line 6, in

from .parsers import earley, xearley, cyk

File "/usr/local/lib/python3.12/site-packages/lark/parsers/earley.py", line 19, in

from .grammar_analysis import GrammarAnalyzer

File "/usr/local/lib/python3.12/site-packages/lark/parsers/grammar_analysis.py", line 9, in

from ..common import ParserConf

File "/usr/local/lib/python3.12/site-packages/lark/common.py", line 60

self.ignore = ignore

                    ^

IndentationError: unindent does not match any outer indentation level

[ElMehdiBouamama-Infomineo]

Not working from my side neither!

[agonbina]

I have to say this makes me feel like the system is still very unstable.

I have been trying to run R2R using docker compose (instead of the, what I find to be unnecessary, r2r CLI wrapper) and it's been quite frustrating. I understand hatchet brings a lot of complexity too but you need to work on preventing simple regressions such as this, and reduce the number of configuration paths one can follow so that we have one stable way to run the system.

[NolanTrem]

This is related to a corrupted binary with a specific version of Lark—I'm working to reach out to the Lark team to alert them of this, and we'll publish a new image with a pinned version of Lark that does not have this problem. @agonbina I'm curious what commands you are running to start the docker that haven't been working for you. I haven't experienced issues starting Docker directly, albeit I am working on the project, so I may overlook things that are otherwise confusing.

[agonbina]

@NolanTrem what docker image version should we downgrade to be able to avoid the Lark issue?

[NolanTrem]

This should be working: ragtoriches/prod:3.3.31

[agonbina]

That does work indeed. I ended up using an external postgres database but I finally have things running now. Thanks!